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SEECIEICAIIflM 

OB JECTPOSraON DEIECrOR 
WHH EDGE MOTION FEATURE 
AND GESTURE RECXXjNTnON 



RELATED APPUCATIONS 
niis ^plicatiOT is a continuation-in-part of co-pending application Serial No. 
08/320,158. ffled October 7, 1994, which is a continuation-in-pan of co-pending appUcation 
Serial No. 08/300387, filed September 2. 1994, which is a continuation-in-part of application 
Serial No. 08/115,743. filed August 31, 1993, now United States Patent No. 5,37^,787, which 
is a continuaiion-in-part of co-pending application Serial No. 07/895,934. filed June 8, 1992. 

BACKGROUND OF THE INVENTION 

1. Held Of The Invention 

Ihe present invention relates to object position sensing transducers and sysl^ More 
particulariy. the present invention relates to object position recognition useful in appUcations such 
as cursor movement for computing devices and other appUcations. and especially to cursor 
movement with enhanced edge-motion and gestute-iecognition features. 

2. The Prior Art 

Nunwsrous devices aie available or have been proposed for use as object position 
deteclois for use in computer systems and other appUcations. Hie most &mifiar of such devices 
isthecomputer"mouse". While extremely popular as a position indicating device, a mouse has 
mechanical parts and requires a surface upon which to loU its position balL Furthermore, a 
mouse usually needs to be moved over long distances for reasonable resolutibn. Knally, a mouse 
requires die user to Uft a hand fiom the keyboard to make U« cursor movement, tiiereby upsetting 
die prime purpose, which is usuaUy Qrping on the computer. 

TrackbaU devices are similar to mouse devices. A major difference, however is that, 
onUke a mouse device, a trackball device does not require a surface across which it must be 
rolled. TrackbaU devices are stiU expensive, have moving parts, and require a relatively heavy 
touch as do the mouse devices. TTiey are also h»ge in size and doe not fit well in a volume- 
sensitive appUcation like a li^)top computer. 



nierc arc several available touch-sense technologies which may be employed for 
position indicator. Resistive-membrane position sensors arc known and used in several 
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applications. However, they generally suffer from poor resolution, the sensor surface is expo^^ 
to the user and is thus subject to wear. In addition, resistive-membrane touch sensors are 
relatively expensive. A one-surface q>proach requires a user to be grounded to the sensor for 
reliable operation, This cannot be guaranteed in pcnrtable computers. An example of a one- 
surface approach is the UnMouse product by MicroTouch, of Wilmington, MA A two-surface 
approach has poorer resolution and potentially will wear out very quickly in time. 

Resistive ublets are taught by United States Patent No. 4,680,430 to Yoshikawa, United 
States Patent No. 3,497,617 to Ellis and many otiiers. The drawback of all such approaches is 
the high power consumption and the high cost of the resistive membrane employed 

Surface Acoustic Wave (SAW) devices have potential use as position indicators. 
However, this sensor technology is expensive and is not sensitive to light touch. In addition, 
SAW devices are sensitive to residue buildup on the touch surfaces and generally have poor 
resolution. 

Strain gauge or pressure plate approaches iaie an interesting position sensing technology, 
but suffer from several drawbacks. This q)proach may employ piezo-electric transducers. One 
drawback is tiiat die piezo phenomena is an AC phenomena and may be sensitive to the user's 
rate of movement In addition, strain gauge or pressure plate approaches are somewhat 
expensive because special sensors are requited. 

Optical approaches are also possible but are some^diat limited for several reasons. All 
would require ligiht genc»^on which will require external components and increase cost and 
power drain. For example, a **fihger-breaking'' infra-red matrix position detector consmnes 
hig^ power and suffers from relatively poor resolution. 

There have been numerous attempts to provide a device for sensing the position of a 
thumb or other finger for use as a pointing device to replace a mouse or trackball. Desirable 
attributes of such a device are low power, low profile, high resolution, low cost, fast response, 
and ability to operate reliably when tiie finger carries electrical noise, or when the touch surface is 
contaminated with dirt or moisture. 

Because of the drawbacks of resistive devices, many attempts have been made to provide 
pointing capability based on capacitively sensing die position of tiie fmger. United States Patent 
No. 3,921,166 to Volpe teaches a capacitive matrix in which the finger changes the 
transcapacitance between row and column electrodes. United States Patent No. 4,103,252 to 
Bobick employs four oscUlating signals to interpolate x and y positions between four capacitive 
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electrodes. United States Patent No. 4,455,452 to Schuyler teaches a capacitive tablet wherein 
the finger attenuates the capacitive coupling between electrodes. 

United States Patent No. 4,S50,221-to Mabusth teaches a capacitive tablet wherein the 
effective cq>adtance to "victual ground** is measured by an oscillating signal Each row or 
cdumn is polled sequentially, and a rudimentaiy form of interpolation is applied to lesolye tiie 
position betweoi two rows or columns. An attempt is made to address the problem of electrical 
interference by averaging over many cycles of die oscillating waveform. The problem of 
contamination is addressed by sensing when no finger was present, and applying a periodic 
calibration during such no-finger-present periods. United States Patent No. 4,639,720 to 
Rympalski teaches a tablet for sensing die position of a stylus. The stylus alters tixe 
transcapadtance coupling between row and column electrodes, which are scanned sequentially. 
United States Patent No. 4.736,191 to Mat:dce teaches a radial electrode airangement under the 
space bar of a keyboard, to be activated by touching wifli a tfiumb. TTus patent teaches die use of 
tot^ touch capacitance, as an indication of the touch pressure, to control die velocity of cuisor 
motion. Pulsed sequential polling is employed to address the effects of electrical interference. 

United States Patent Nos. 4,686,332 and 5.149,919, to Gieanias, teaches a stylus and 
finger detection system meant to be mounted on a CRT. As a finger detection system, it's X/Y 
sensor matrix is used to locate ti»e two matrix wires carrying die maximum signaL Wifli a coding 
scheme tiiese two wires uniquely determine die location of tiie finger position to die resolution of 
die wire stepping. For stylus detection, Greanias first coarsely locates it, dien develops a virtual 
dipole by driving all lines on one side of die object in one direction and all lines on die opposite 
side in die opposite direction. This is done fluee times witii different dipole phases and signal 
polarities. Assuming a predetermined matrix response to die object, die diree measurements 
present a set of simultaneous equatims diat can be solved for portion. 

United States Patent No. 4.733,222 to Evans is die fust to teach a capacitance touch 
measurement system tiiat inteipolates to a high degree. Evans teaches a diree lenninal 
measurement system dut uses a drive, sense and electrode signal set (3 signals) in its matrix, and 
bases die measurement on die attenuation effect of a finger on die electrode node signal (uses a 
capacitive divider phenomena). Evans sequentially scans dirough each drive set to measure die 
capacitance. Rtom die diree largest responses an interpolation routine is applied to determine 
finger position. Evans also teaches a zeroing technique diat allows "no-finger" levels to be 
cancded out as part of the measurement. 

United States Patent No. 5,016,008 to Gniaz describes a touch sensitive pad diat also 
uses interpolation. Gruaz uses a drive and sense signal set (2 signals) in die touch matrix and 
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The sequential scanning approach of previous systems also made them more susceptible 
to noise. Noise levels could change between successive measurements, thus changing the 
measured signal and the assumptiohs used in interpolation routines. 

Finally, all previous approaches assumed a pardcular signal response for finger position 
versus matrix position. Because the transfer curve is very sensitive to many parameters and is 
not a smooth linear curve as Greanias and Geipheide assume, such approaches are limited in the 
amount of intopolation they can perform. 

In prior co-pending application serial No. 08/115,743, fUed August 31, 1993, now 
United States Patent No. 5,734,787, a two-dimensional capacitive sensing system equipped with 
a separate set of drive/sense electronics for each row and for each column of a capacitive tablet is 
disclosed. All row electrodes are sensed simultaneously, and all column electrodes are sensed 
simultaneously. The sensed signals are processed by analog circuitry. 

Of the touchpad devices cunendy available, only the Alps/Cirque GlidcPoint includes 
gesture recognition. The GlidePoint supports basic t^, double-tap, and drag gestures to 
simulate actions on a primary mouse button. It does not support multiple-finger gestures, nor are 
there gestures for simulating secondary button clicks. No information is known about the 
implementation methods employed in the GlidePoint However, the GlidePoint is known to have 
difficulty with double-taps, one of the problems addressed by the present invention. The 
GlidePoint exhibits a hesitation on each finger-motion stroke which may be an attempt to stabilize 
the cursor during tap gestures. Also, the GlidePoint must rely on physical switches or extremely 
high gain or acceleration in order to aUow drags over long distaiices. 

One touchpad product, the UnMouse, mounts a switch underneath its resistive sensor so 
that the user simply presses down on the pad to activate the buttoa Aside from requiring fragile 
and complex mechanical mounting, this device also is reported to be very tiring to the user. 

Graphics tablets operated by a pressure sensitive stylus instead of a finger are well known 
intheart Thesedevicestypically use a mechanism like the "push" gesture of die pi^ 
invention to simulate actuator switches. No other gestures of the sort described herein have been 
seen in stylus operated tablets. 

It is thus an object of the present invention to provide a two-dimensional capacitive 
sensing system equipped with a separate set of drive/sense electronics for each row and for each 
column of a capacitive tablet, wherein all row electrodes are sensed simultaneously, and all 
column electrodes are sensed simultaneously. 
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BRIEF DESCRIPTION OF THE INVENTION 
With the advent of vciy high levels of integration, it has become possible to integrate 
many channels of driving/sensing dectronics into tme integrated circuit, along with the control 
logic for operating diem, and the intexface electronics to allow the pointing device to communicate 
5 directly wiA a host miciK^nocessor. The present invention uses adaptive analog techniques to 
overcome offset and scale differences between channels, and can thus sense either 
transcapacitance or sdf-capacitance of all tablet rows or columns in parallel. Hiis parallel- 
sensing capability, made possible by providing one set of electronics per row or column, allows 
the sensing cycle to be extremely short, thus allowing fast response whUe stiU maintaining 
10 inununity to very high levels of electrical interfeierce. 

The presmt invoition comprises a position-sensing techriology particularly useful for 
applicati(ms where finger position infotmatiai is needed, siidi as in computer "mouse" or 
trackbafl environments. However the position-sensing technology of the present invention has 
much more general application than a computer mouse, because its sensor can detect and report if 
one or more points are being touched. In addition, the detector caih sense die pressure of die 
touch. 

According to a preferred embodiment of the present invention, refened to herein as a 
"finger pointer* embodiment, a position sensing system includes a position sensing transducer 
comprising a touch-sensitive surface disposed on a substrate, such as a printed circuit board, 
including a matrix of conductive lines. A first set of conductive lines runs in a first direction and 
is insulated from a second set of conductive lines running in a second direction generaUy 
perpendicular to die first direction. An insulating layer is disposed over the first and second sets 
of conductive lines. Tlie insulating layer is thin enough to promote significant capadtive 
coupling between a finger placed on its surface and the first and second sets of conductive lines. 

25 Sensing electronics respond to die proximity of a finger, conductive object, or an object 

of high dielectric constant (i.e., greater tiian about 5) to translate the capacitance changes of die 
conductors caused by object proximity into digital information which is processed to derive 
position and touch pressure infonnation. Its output is a simple X, Y and pressure value of die 
oneobjectonitssurfiice. In all descriptions herein, fingers are to be considered interchangeable 

30 widicmiductive objects and objects of high dielectric constant 

Different prior art pad scan techniques have different advantages in different 
environments. Parallel drive/sense techniques according to die present invention allow input 

samples to be taken simultaneously, dius all channels arc affected by die same phase of an 
interfering electrical signal, greatiy simplifying die signal processing and noise filtering. 
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According to yet another aspect of the present invention, a capacitance measuiement 
technique which is easier to calibrate and implement is mployed. 

According to two aspects of the presmt invention, when the presence of a fmger or other 
conductive object is sensed within a defined peripheral region of die sensing plane, the control of 
5 cursor motion may be changed to provide "edge motion** to allow control of large cursor 
excursions on a display screen from a single gesture executed on a small sensing plane. 

According to another aspect ojf the invention a drag extension gesture is recognized by the 
host which permits the control of large cursor excursions on a display screen from a single 
gesture executed on a small sensing plane. 

1 0 According to a further object of the present invention, a number of gestures made by a 

fmger or odier object on the touch-sensor pad are recognized and communicated to a host 
Recognition of whether certain gestures are made by novice or expert users is also pix)vided. 
Compensation for unintraded motion of the fing^ or other object during expression of the 
gestures is provided. 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an overall block diagram of die capacitive position sensing system of the 
present invention. 

FIG. 2a is a top view of an object position sensor transducer according to a presently 
preferred embodiment of the invention showing the object position sensor surface layer including 
20 a top conductive trace layer and conductive pads connected to a bottom trace layer. 

FIG. 2b is a bottom view of the object position sensor transducer of FIG. 2a showing the 
bottom conductive trace layer. 

FIG. 2c is a composite view of tiie object position sensor transducer of FIGS. 2a and 2b 
showing both the top and bottom conductive trace layers. 

-5 FIG. 2d is a cross*sectional view of the object position sensor transducer of FIGS, 2a- 

2c. 

FIG. 3 is a block diagram of sensor decoding electronics which may be used with the 
sensor transducer in accordance with a preferred embodiment of die present invention. 



9 



wo 97/36225 FCT/US97/0S333 

HG. 4a is a simplified schenuitk diagram of a Charge integrat^^ 
us^ in the present invention. 

FIG. 4b is an iUustiative schematic diagrani of the charge integrator circuit of HG. 4a. 
FIG 5 is a timing diagram of the operation of charge integrator circuit of HGS. 4a and 

4b. 

HG. 6 is a schematic (fiagram of an iUustiative filter and samplcftiold circuit for use in the 
present invoition. 

HG. 7 is a more detailed block diagram of a presenUy preferred aiiangement of A/D 
converters for use in the present invention. 

FIG. 8 is a block diagram of an iUustiative arithmetic unit which may be used in the 
present invention. 

HG. 9 is a block diagram of a calibration unit which may be used with the arithmetic unit 
ofHG.8. 

HG. 10 is a schematic diagram of a bias voltage generating circuit usefiil in the present 
invention. 

HG. 11 isadiagramof the sensing plane illusiiating the edge motion feature of the object 
position sensor of tiie present invention. 

HG. 12A is a schematic diagram illustrating a first hardware implementation of the 
determinationofwhetherafingerorotherobjcctispresentintheperipheralregionsofthe 

sensing plane. 

HG. 12B is a schematic diagram iUustrating a first hardware implementation of the 
determinationofwhetherafingerorotherobjectispresentintheperipheraliegionsofthe 

sensing plane. 

HG. 13 is a schematic diagram illustrating hardware implementation of tiie edge motion 
feature of die present invention. 

HG. 14 is a more detailed block diagram of gesture unit 20 of HG. 1. 
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FIGS. 15a through ISg are timing diagnuns illustrating some of the gestures which may 
be recognized according to the present invention. 

FIGS. 16a and 16b are diagrams illostrating two tap zone Shapes which may be used on 
stbsor pads according to the present invention. 

HGS 17a through 17f comprise a flowchart illustrating the operation of the tap unit of 
HG. 14. 

FIGS. 18a through 18c comprise a flowchart illustrating the operation of the zigzag unit 
ofHG. 14, 

HG. 19 is a timing diagram illustrating a "push" gesture according to the present 
invention. . . 

FIG. 20 is a flowchart illustrating the operation of the push unit of FIG. 14. 

HG. 21 is a block diagram of an iUustrative UftJump suppressor dicuit which may be 
used in gesture recognition according to die present invention. 

DETAILED DESCWnON OF A PREFKIRED EMBODIMENT 
This plication is a C(»timiation-in-part of co-pending ^plication serial No. 
08^00,387. filed September 2. 1994, which is a continuation-in-part of co-pending appUcation 
serial No. 08/1 15.743. filed August 31. 1993, now United States Patent No. 5374,787, which 
is a continuation-in-part of co-pending appUcation serial No. 07/895,934, filed June 8, 1992. 
The present invention continues the approach disclosed in the parent applications and provides 
more unique feanores not previously available. These improvements provide a more easfly 
integrated soluUon, increased sensitivity, and greater noise rejection, increased data acquisition 
rate and decreased power consumption. Tlie present invention aUows for continuous self 
calibration to subtract out the efGects of environmental changes and aUows for enhanced cursor 
control finm edge motion (m a senang plane. 

Those of ordinary skill in the art will realize that die fidlowing description of the present 
invention is illusttative only and not in any way limiting. Odier embodiments of die invention 
wiU readUy suggest thcanselves to such skilled persons. 

TTie present invention brings together in combination a number of unique features which 
allow for new appUcations not before possible. Because die object position sensor of the present 
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invention has very low power requirements, it is beneficial for use in battery operated or low 
power applications such as lap top or portable computers . : It is also a veiy low cost solution, 
has no moving parts (and is theiefote virtually maintenance free), and uses the existing printed 
circuit board traces for sensors. The sensing technology of the present invmtion can be 
integrated into a computer motherboard to even further lower its cost in computer applications. 
Similarly, in other applications the sensor can be part of an already existent circuit board. 

Because of its small size and low profile, the sensor technology of the present invention 
is useful in lap top or portable applications where volume is an important consideration. The 
sensor technology of the present invention requires circuit board space for only a single sensor 
interface chip that can interface directly to a microprocessor, plus the area needed on the printed 
circuit board for sensing. 

Referring first to FIG. 1 , a simplified block diagram of the capaciti ve position sensing 
system 6 of the present invmtion is presented Capadtive position sensing system 6 can 
accurately detemuK the position of a finger 8 or oihet conductive object proxitnate to or touching 
a sensing plane 10. Tte capacitance of a plurality of conductive lines running in a first direction 
(e.g./'X*') is sensed by X mput processing circuitry 12 and the capacitance of a plurality of 
conductive lines running in a second direction (e.g., "TO is sensed by Y input processing 
circuitry 14. The sensed capacitance values are digitized in both X input processing circuitry 12 
and Y input processing circuitry 14. llie outputs of X input processing circuitry 12 and Y input 
processing circuitry 14 are presented to arithmetic unit 16, which uses the digital informatim to 
derive digital information representing tiie position and pressure of the finger 8 or other 
ccmductive object relative to the sensing plane 10. 

The X, Y, and Z outputs of arithmetic unit 16 arc directed to motion unit 1 8 which 
provides the cursor motion direction signals to die host computer. Those of ordinary skill in die 
art will recognize, that as used herein, "host*' may mean a stand-alone computer such as an IBM 
or compatible PC or compute made by Apple Computers, hand-held control units, personal 
digital assistants, remote conununication devices, or die like, or to any oflier devices or systems 
which can take as input the output of a touch tablet 

The X, Y, and Z outputs of aritiunetic unit 16 are also directed to gesture unit 20, which 
is used to recognize certain finger gestures performed by a user on sensing plane 10. In addition, 
gesture uiut 20 may produce a signal to motion unit 18 to enable die edge motion feature of the 
present invention based on die state of gesture processing. 
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Hie sensor material can be anything that allows creation of a conductive X/Y matrix of 
pads. This includes not oiily standard PC boards, but also includes but is not limited to flexible 
PC boards, conductive elastpmer materials, silk-screened conductive lines, and piezo-electric 
Kynar plastic materials. This renders it useful as well in any portable equq)ment application or 
in human interface where die sensor needs to be molded to fit witiiin the hw^^ 

The sensor can be conformed to any three dimensional surface. Coppercan be plated in 
two layers on most any surface contour producing the sensor. Tliis will allow die sensor to be 
adapted to the best ergonomic form needed for any particular application. This coupled witii die 
"light-touch" feature will make it effortless to use in many applications. The sensor can also be 
used m an indirect manner, i.e it can have an insulating foam material covered by a conductive 
layer over die touch sensing surface and be used to detect any object (not just conductive) tiiat 
presses against it's surface. 

Small sensor areas are practical, Le., a presendy conceived embodiment tates about 
1.5"x 1.5" of area, however tiiose of ordinary skill in die art will recognize that the area is 
scaleable for different appUcations. The matrix area is scaleable by dAer varying the matrix trace 
spacing or by varying die number of traces. Large sensor areas are practical where more 
. information is needed. 

Besides simple X and Y position information, tb& sensor technology of die present 
invention also provides finger pressure information. This additional dimension of information 
may be used by programs to control spedal features such as "bnish-widdi" modes in Paint 
programs, special menu accesses, etc., aflowing provision of a more natural sensory input to 
computers. It has also been found useful for implqnenting •'mouse click and drag'' modes and 
for simple i2q)ut gestures. 

The user win not even have to touch die surface to generate die minimum reaction. This 
feature can gready minimize user strain and allow for more flexible use. 

The sense system of die present invention depaids on a transducer device capable of 
providing position and pressure information regarding the object contacting die transducer. 
Referring now to HQS. 2a-2d. top, bottom, composite, and cross-sectional views, respectively, 
are shown of a presenfly-preferred sensing plane 10 comprising a touch sensor array 22 for use 
in die present invention. Since capacitance is exploited by diis embodiment of die present 
invention, die surface of touch sensor array 22 is designed to maximize die capacitive coupling to 
a finger or other conductive object 



13 



^^^'''^aiZS PCT/US97/0S333 

A iH«sently preferred touch sensor array 22 according to the present invention comprises 
a substrate 24 including a set of first conductive traces 26 disposed on a top surface 28 thereof 
and run in a first direction to comprise row positions of the array. A second set of conductive 
traces 30 aie disposed on a bottom surface32 tiiereof and run in a second direction preferably 
orthogonal to the first direction to form the column positions of the array. The top and bottom 
conductive traces 26 and 30 are^temately in contact with ptaiodic sense pads 34 comprising 
enlarged areas, shown as diamonds in HQS. 2a-2c. While sense pads 34 are shown as 
diamonds in HQS. 2a-2c, any shape, such as circles, which allows them to be closely packed is 
equivalent for purposes of this invention. As an arbitrary convention herein, the first conductive 
traces 26 will be referred to as being oriented in the "X" or "row" direction and may be referred 
to herein sometimes as "X lines" and the second conductive traces 30 will be referred to as being 
oriented in the ' V or "column" direction and may be referred to herein sometimes as "Y lines". 

The number and spacing of diese sense pads 34 depoids upon die resolution desired. 
For example, in an actual «nbodiment consiructed accwding to the principles of the present 
invention, a 0.10 inch cenier-to-centOT diamond-shqied pattern of conductive pads di^iosed 
along a matrix of 15 rows and 15 columns of conductors is employed. Every other seaso pad 34 
in each direction in the pad pattern is connected to conductive traces (m the top and bottcnn 
surfaces 28 and 32, respectively of substrate 24. 

Substrate 24 may be a printed circuit board, a flexible dicuit board or any of a number of 
availatdedrcuit interconnect technology structures. Itsdiidmessisunimpoitantaslongas 
contact may be made theredirough from the bottom conductive traces 30 to their sense pads 34 on 
the top surface 28. The printed circuit board comprising substrate 24 can be cmstnicted using 
standard industry techniques. Board tfiickness is notimportanL Connections fiom the 
conductive pads 34 to the bottom traces 30 may be made employing standard plated-tfatxMgh hole 
techniques well known in the printed circuit board art. 

In an alt^iiate embodiment of the present invention, the substrate material 24 may have a 
thickness on the order of 0.005 to 0.010 inches. Tlien the diamonds on the upper surface 28 
and the plated duough holes that connect to the lower surface traces 30, can be omitted, furdier 
reducing the cost of the system. 

An insulating layer 36 is disposed over the sense pads 34 on top surface 28 to insulate a 
human finger or other object therefrom. Insulating layer 36 is preferably a thin layer (i.e., 
approximately 5 mils) to Iceep capacitive coupling large and may comprise a material, such as 
mylar, chosen for its protective and ergpnomic characteristics. The term "significant capacitive 
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coupling" as used herein shall mean capadtive coupling having a magnitude greater than about 
0.5pF. 

There are two di£ferent c^»citive ^ec^ taking place \rtien a finger approaches the touch 
sensor array 22. The first capadtive effect is trans-ci^iadtance, or coupling between sense pads 
34, and die second capacitive effea is self-capacitance, or coupling to virtual ground. Staang 
circuitry is coupled to die sensor aitay 22 of die present invention and responds to changes in 
eiUier or bodi of diese capadtances. This is important because die relative sizes of the two 
capadtances change greatly depending on tiie user environment The ability of die present 
invention to detect changes in bodi self capacitance and trans-capadtance results in a veiy 
versatile ^stem having a wide range of applications. 

According to die prefened embodiment of die invention, a poation sensor systwn 
including touch sensor array 22 and assodated position detection ciicuitiy will detect a finger 
position on a matrix of printed dnaut board traces via die, capadtive effect 
die sensor array 22. The position sensor system will report die X, Y position of a finger phiced 
near die sensor array 22 to much finer resolution dian die spacing between die row and column 
traces 26 and 30. The position SMisor according to diis embodiment of die invention will also 
report a Z value proportional to die oudine of diat finger and hence indicative of die pressure witii 
which die finger contacts die surface of insulating layer 36 over die sensing array 22. 

According to die presendy prefened embodiment of die invention, a very sensitive, light- 
touch deiBctOT circuit may be provided using adiqitive analog and digital VLSI techniqnes. The 
circuit of die present invention is very robust and calibrates out process and systematic eirois. 
The detector circuit of die presem invention will process die capadtive input infoimation and 
provide digital information which may be presented direcUy to a micioprocessor. 

According to diis embodiment of die invention, sensing circuitry is contained on a single 
sensor processor integrated circuit chip. The sensor processor chip can have any number of X 
and Y "matrix" inputs. The number of X and Y inputs does not have to be equal. The Integrated 
circuit has a digital bus as output In die illustrative example disclosed in HQS. 2a-2d herein, 
die se»sor array has 15 traces in bodi die X and Y directions: TTie sensor processor chip dius has 
15 X inputs and 15 Y inputs. An actual embodunent constructed according to die prindples of 
die present invention employed 18 traces in die X direction and 24 traces in die Y direction. 
Those of ordinary skiU in die art will recognize diat die size of die sensing matrix which may be 
employed in die present invention is arbitrary and wiU be dictated largdy by design chdce. 
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The X and Y matrix nodes are driven and sensed m parallel, wth the capa^^ 
Hrformation from each line indicating how close a finger is to that node. The seamed information 
provides a profile of the finger proximity in each dimension. According to this aspect of the 
present invention, the profile cenfiroid is derived in both the X and Y directions and is the 

P(«tion in that dimension. Tl« profile curve of proximity is also integn^^ 
information. 

n»erc are two drive and sense methods employed in the touch sensing technology of the 
present invention. Acconling to a first and presently preferred embodiment of the inventibn. the 
voluges on all of the X lines of the sensor matrix are simultaneously mov^^ 
of the Y hnes are held ata constant voltage. Next, the voltages on all of the Y lines of the sensor 
manx are simultaneously moved, while the voltages of the X lines are held at a constant voltage 
■nns scannmg method accentuates the measurement of capacitance to virtual ground provided by" 

the finger. ""tose of ordinary skill in the art will recognize that order of tiiese two steps is 
somewhat arWtrary and may be reversed. 

Accordmg to a second drive/sense method, the voltages on aU of the X lines of the sensor 
mamxaresmiultaneously moved in a positive direction, while the voltages of the Y lines are 
moved m a negative direciioa Next, the voltages on aU of the X lines of the sensor matrix are 
smiulteneously moved in a negative direction, while the voltages of the Y lines are moved in a 
positive direction. TWs second drive/sense method accentuates transcapacitance and de- 
«nphasizes virtual gromid capacitance. As with the first drive^sense method, those of ordinary 

skiH m the art wiU recognize that Older of these two steps is somewhat arbitrary and may be 
reversed. 



Inferring now to HG. 3. a block diagnmi of die presently prcfened sensing ciicuitiy 40 
for use acconling to the present invention is presented, niis block diagram, and the 

accompanying disclosure, relates to the sensing circuitry in one dimension (X) only, and includes 
theXnipwprck«ssingcircuitryl2ofHG.l. TTwse of ordinary ddU in the art wiU appreciate 
that an identical circuit would be used for sensing the opposite (Y) dimension and would include 
the Ymput processing circuitry MofHO. 1. Such skifled persons wiU furthernote tiiat the two 
dimensions do not need to be orthogonal to one another. For example, they can be radial or of 
any other nature to match the contour of the touch sensor array and other needs of die system 
Those of OKlinaiy skiU in the art will recognize that the technology disclosed herein could be 
applied as weU to a one^mensional case where only one set of conductive traces is used. 

nie capacitance at each sensor matrix node is represented by equivalent capacitois 42-1 
lhiough42.n. niecapaciianceofcapacitors42-l through 42-n comprises the capacitance of the 
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matrix conductors and has a characteristic background value when no object (e.g.« a finger) is 
proximate to the sensing plane of the sensor matrix. As an object appioadies the sensing plane 
the capacitance of capacitors 42-1 through 42-n increases in proportion to the size and proximity 
of the object 

According to the present invention, the capacitance at each sensor matrix node is . 
measured simultaneously using charge integrator circuits 44-1 through 44-n. Charge-integrator 
circuits 44-1 through 44-n serve to inject charge into the capacitances 42-1 through 42-n, 
respectively, and to develop an output voltage proportional to the capacitance sensed on the 
corresponding X matrix line. Thus charge-integrator circuits 44-1 through 44-n are shown as 
bidirectional amplifier symbols. Each charge-integrator circuit 44-1 through 44-n is supplied 
with an operating bias voltage by bias-voltage generating circuit 46. 

As used herein, the phrase "proportional to the capacitance" means that the voltage signal 
generated is a monotonic function of the sensed capacitance. In the embodiment described * 
herein, the voltage is directly and linearly propoitional to die capacitance s»sed. Those of 
ordinary skill in the art will recognize that otter monotonic functions, including but not limited to 
inverse proportionality, and non-linear proportionality such as logarithmic or exponential 
functions, could be employed in the present invention without departing from the principles 
disclosed herein. In addition current-sensing as well as voltage-sensing techniques could be 
employed. 

According to a presently preferred drive/sense method used in the preset invention, the 
capacitance measurmients are performed simultaneously aa^oss all inputs in one dimension to 
overcome a problan which is inherent in all prior art approaches that scan individual iq)uts. The 
problem with the prior-art ^proach is that it is sensitive to high frequency and large amplitude 
noise Garge dv/dt noise) that is coupled to the circuit via the touching object Such noise may 
distort the finger profile because of noise appearing in a later scan cycle but not an earlier one, 
due to a change in the noise level. 

The present invention overcomes this problem by **taking a snapshot of aU inputs 
simultaneously in X and then Y directions (or visa yersa). Because the injected noise is 
proportional to fte finger agnal strength across all mputs, it is therefore symmetric around the 
finger centroid. Because it is symmetric around the finger centroid it does not affect the finger 
position. Additionally, the charge amplifier p^orms a differential measuring function to further 
reject common-mode ncnse. 
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^ Because of the nature of the charge integrator circuits 44-1 through 44-n. their outputs 

wmbechangingovertimeandwilIhavethedesiredvoltageoutputforonlyashorttin.e As 
P«esentlyprefemxi.fiitercircuits48-I through 48-n are implemented as sample and hold 
switched capacitor filters. 

The desired volume is captured by the filter circuits 48-1 through 48-a As controlled by 
control circuitry. 56. the filter dicuits 48-1 through 48-n will filter out any high frequency noise 
from the sensed signal, niis is accomplished by choosing the capacitor for the filter to be much 
.Iargerthantheoutputcapacitanceofchargeintegratorcircuits44-lthrough44-n. Inaddition 
tfaoseof ordinary skiUintheartwillrecognizethattheswitchedcapadtorfilterd^^ ' 
through 48-n wiU capture the desired voltages and store them. 

Accordingiothepresentinvention,thecapacitanceinfocmaiionobtau^ 
fromthecapacitancemeasurementsisdigiti2Bdandp.t«^ Accordingly the 

voltages stored by filter circuits 48-1 through 48.n are stored in samplefliold circuits 50-1 ' 
ftrough 50-n so that the remainder of the circuitry processes input data taken at the same time 
Sample/bold circuits 50-1 through 50-n may be configured as conventional sampleflKrfd ciicuiis 
as is wen known in the art 

The sampled analog voltages at the ouQ)uts of samplertwid circuits 50-1 through^5^^ 
digitized by analog-to-digital (A/D) converters 52. As presently preferred, A/D converters 52 

resolve the input voluge toa lO-Wt wide digitalsignalCaiesolution of one part in 1 024) 
although those of ordinary skill in the art will realize that other resolutions may be employed. 
AA> converters 52 may be conventional successive approximation type converters as is known in 
theart 

Given the charge integrator circuitry employed in the present invention, the background 
level (no object present) of the charge integrator outputs will be about 1 volL Hie AV resulting 
from the presence of a finger or other object will typically be about 0.4 volt. The voltage range 
of the A/D converters 52 should dierefore be in the range of between about 1-2 volts. 

An important consideration is the minimum and maximum voltage lefisrence points for the 
AA> converters (V^ and V^). It has been found that noise will cause position jitter if these 
reference voltages are fixed points. A solution to this problem which is employed in the present 
invention is to dynamicaUy generate the and reference voltages from reference 
-capacitances 42-Vmin and 42-Vmax. sensed by charge integrator circuits 44-Vmin and 44-Vmax 
andprocessedbyfiltercircuits48-Vminand48-Vmax and stored in sample/hold circuits 50- 
Vmin and 50-Vmax . In this manner, any common mode noise present when the signals are 
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sampled from the sensor array will also be present in the and reference voltage values 

and will tend to cancel Those of ordinary skill in the art will realize that reference capacitances 
44-Vmin and 44-Vmax may either be discrete capacitors or extra traces in the sensor airay. 

According to the present invention, the V^^ reference voltage is generated from a 
c^acitor having a vahie equal to the lowest c^>acitance expected to be encountered in the sensor 
array with no object present (about 12pF assuming a 2 inch square sensor airay). The V„„ 
referoxs voltage is geiieratBd from a capacitor having a value equal to the largest capacitance 
ejq)ected to be encountoed in die sensor array with an object present (about 16pF assuming a 2 
inch square sensor array). 

The ou^uts of A/D converters 52 provide inputs to arithmetic unit 16. As wiU be more 
fiiUy disclosed with reference to FIG. 8, the function of arithmetic unit 16 is to compute the 
waghted average of the signals on the individual sense lines in both the X and Y directions in the 
touch sensor array 22. Thus, arithmetic unit 16 is shared by the X input processing circuitiy 12 
and the Y input processing circuitry 14 as shown in HG. 1. 

Control circuitiy 56 of HG. 3 orchestrates flie operation of the remainder of the dnndtiy. 
Because the system is discretdy sampled and pipelined in its operation, control drcm 
present to manage the signal flow. The functions performed by control circuitry 56 may be 
conventionally devdc^ via viiat is commraly known in die ait as a state machine or 
microcontroller. 

The structure and operation of the individual blocks of FIG. 3 will now be disclosed. 
Referring now to FIGS. 4a. 4b, and 5, a typical charge integrator circuit will be described. 
Charge integrator circuit 44 is shown as a simplified schematic diagram in HG. 4a and as an 
illustrative schematic diagram in HO. 4b. Hie timing of the operation of charge integrator circuit 
44 b ^own in FIG. 5. These timing agnals are provided by die controller block 56. 

Chaige integrator circuit 44 is based on die fundamental physical phenomena of usmg a 
current to charge a capacitor. If the capacitor is charged for a constant time by a constant cunent. 
dien a voltage will be produced on the capacitor which is inversely proportional to t^ 
capacitance. TTie capacitance to be charged is the sensor matrix line capacitance 42 in parallel 
widi an internal c^>acitor. Thisintcmalc£q)acitorwillcontaindie voltage of interest. 

Refaring now to FIG. 4a, a simplified schematic diagram of an illustrative charge 
integrator ciicuit44 is shown. A chaige integrator circuit input node 60 is connected to one of 
die X (or Y) lines of die sensor matrix. A fiist shorting switch 62 is connected between die 
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clmgeintegratorcircuitinputnode60andVDD,theposWvesupplyn^^ A second shorting 
switch 64 is connected between the charge integrator circuit input node 60 and ground, the 
negative supply rail. A positive coilstanf curcent source 66 is connected to Vdd. the positive 
supply rail and to the charge integrator circuit input node 60 and through a first current source 
switch 68. A negative constant current source 70 is connected to ground and to the charge 
integrator circuit input node 60 and through a second current source switch 72. It is obvious that 
other high and low voltage rails could be used in place of Vdd and ground. 

Afirstintetnal capacitor 74 is connected between and output node 76 of ch^^^ 
integtatorcircuit44. A positive voltage storage switch 78 is connected between output node 76 
andmputnode60. A second mienwl capacitor 80 has one of its plates connected to ground 
through a switch 82 and to ouqmt node 76 of charge integrator circuit 44 thiou^ a switoh 84 
andtheotheroneofitsplaiBsconnectedtoinputnodeeOthroughanegaiivevoltage^^ ' 
switch 86 and to Vdd through a switch 88. Hie ci?.acitance of first and second internal 
capacitances 74 and 80 should be a small fraction O-e.. about 10%) of the capacitance of the 
individual sensor matrix lines. In a typical embodiment, the sensor matrix line capadtancewiU 
be about lOpF and the capacitance of capacitors 74 and 80 should be about IpF. 

According to the presently ptefened embodiment of the invention, the approach used is a 
differential measuiement for added noise immunity, the benefit of which is that any low 
fiequency common mode noise gets subtracted out For the foflowing discussion, it is to be 
assumed that all switches are open unless they are noted as closed. Fust, the sensor matrix line 
is momentarily shorted to Vdd through switeh 62. switch 78 is closed comiecting capacitor 74 in 
parallel with the capacitance of the sensor line. Tljen the parallel capacitor combination is 
discharged with a constant current from current source 70 through switch 72 for a fixed time 
period. At the end of the fixed time period, switch 78 is opened, thus storing the voltage on the 
sensor matrix line on capacitor 74. 

The sensor line is then momentarily shorted to ground through switch 64. and switches 
82 and 86 are closed to place capacitor 80 in parallel with the capacitance of the sensor line. 
Switch 68 is closed and the parallel capacitor combination is charged with a constant current from 
current source 66 for a fixed lime period equal to the fixed time period of the first cycle. At the 
Old of the fixed time period, switch 86 is opened, thus storing the voltage on the sensor matrix 
line on capacitor 80. 

The first and second measured voltages are then averaged. Hiis is accomplished by 
opening switch 82 and closing switehes 88 and 84. which places capacitor 80 in parallel with 



20 



wo 97/36225 PCT/US97/05333 

capacitor 74. Because ca|>acitors 74 and 80 have the same capacitance, the resulting voltage 
across diem is equal to the average of the voltages across each individually. Hus final result is 
the value that is then passed on to the apprq)riatB one of filter circuits 48-1 through 48-n. 

TTie low frequency noise, notably 50/60 Hz and their harmonics, behaves as a DC current 
componoit that adds in one measurement and subtracts in the other. When the two results are 
added together that noise coii4>onent averages to lao. Tlie amount of noise rejection is a 
function of how quickly in succession the two opposing charge-up and charge-down cycles are 
performed as will be disclosed herein. One of the reasons for the choice of this charge integrator 
circuit is that it allows measurements to be taken quickly. 

Refiaring now to FIG. 4b, a more complete schematic diagram of an illustrative 
embodiment of charge integrator circuit 44 of the simplified diagram of FIG. 4a is shown. Input 
node 60 is shown connected to V,^ and ground through pass gates 90 and 92, which replace 
switches 62 and 64 of HG. 4a. Pass gate 90 is controlled by a signal ResetUp pi«sented to its 
control input and pass gate 92 is controlled by a signal ResetDo presented to its control input 

Those of ordinary skill in the art wiU recognize that pass gates 90 and 92, as well as aU of the 
other pass gates which are represented by the same symbol in HG. 4b may be conventional 
CMOS pass gates as are known in the art The convention used herein is that the pass gate win 
be off when its control input is held low and will be on and present a low impedance connection 
when its control input is held high. 

P-Channel MOS transistors 94 and 96 are configured as a current mirror. P-Channel 
MOS transistor 94 serves as the current source 66 and pass gate 98 serves as switch 68 of HG. 
4a. TTie control input of pass gate 98 is ctmtrolled by a signal StepUp. 

N-Channel MOS transistors 100 and 102 are also configured as a current mirror. N- 
Channel MOS transistor 100 SCTves as the current source 70 and pass gate 104 serves as switch 
72 of FIG. 4a. The control input of pass gate 104 is controlled by a signal StepDn. P-Channd 
MOS transistor 106 and N-Channd MOS transistor 108 are placed in series with P-Channel 
MOS current mirror transistor 96 and N-Channel MOS current mirror transistor 102. The control 
gate of P-Channel MOS transistor 106 is driven by an enable signal EN, which turns on P- 
Channel MOS traiisistor 106 to energize the cunent mirrors. This device is used as a power 
conservation device so that the charge integrator circuit 44 may be turned off to conserve power 
when it is not in use. 

N-Channel MOS transistor 108 has its gate driven by a reference voltage Vbias. which 
sets the current through current mirror transistors 96 and 108. The voltage VMas is set by a 
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servo feedback circuit as wiU be disclosed in more detail with reference to HG. 10. Those of 
otdinaiy skill in the art wiU appreciate that this embodiment aUows calibiation to occur in real 
time (via long time constant fi»dback) thereby zeroing out any long term effect 
environmental changes. In a ciment embodiment of the invention. Vbias is common for all 
chaige integrator dicuits 44-1 through 44-n and 44.Vmax and 44-Vmin. 

Note that proper sizing of MOS transistors 102 and 108 may provide temperature 
compensation. This is accomplished by taking advantage of the fact that the tfaiesbold of N- 
Channd MOS transistor 108 reduces with temperature while the mobiUty of both N-Channd 
MOS transistors 102 and 108 reduce with temperature. The threshold reduction has the effect of 
increasing the current while the mobility reduction has the effect of decreasing the cunew. By 
proper device sizing these effects can cancel each other out over a significant part of the operating 
range. 

Capacitor 74 has one plate connected to Vdd and the other plate connected to fl^ 
node 76 and to die input node 60 through pass gate 1 10, shown as switch 78 in FIG. 4a. Hie 
control input of pass gate 110 is driven by the control signal SUp. One plate of capacitor 80 is 
connected to input node 60 through pass gate 1 12 (switch 86 in FIG. 4a) and to VDD through 
pass gate 1 14 (switch 82 in HG. 4a). The control input of pass gate 11 2 is driven by the control 
signal SDn and the control input of pass gate 114 is driven by the control signal ChUp. n«j 
other plate of capacitor 80 is connected to ground through N-Channel MOS transistor 1 16 
(switch 82 in HG. 4a) and to output node 76 through pass gate 1 18 (switch 84 in FIG. 4a). The 
control input of pass gate 1 1 8 is driven by control signal Share. 

Referring now to FIGS. 4a, 4b and the timing diagram of FIG. 5, the operation of charge 
integrator circuit 44 during one scan cycle may be observed. First the EN (enable) control signal 
goes active by going to Ov. This turns on the current mirrors and energizes the chaige and 
discharge current sources, MOS transistors 94 and 100. Tlie ResetUp control signal is active 
high at this time, which shorts the input node 60 (and the sensor line to which it is connected) to 
The SUp control signal is also active high at tiiis time ixiiich connects capacitor 74 and tbe 
output node 76 to input node 60. ThU aiiangement guarantees that the following discharge 
portion of die operating Qrcle always starts from a known equilibrium state. 

The discharge process starts after die ResefUp control signal goes inactive. The 
StepDn control signal goes active, connecting MOS transistor 100. the discharge current source, 
-io the mput node 60 and its associated sensor line. StepDn is active for a set amount of time, 
and die negative constant current source discharges the combined capacitance of die sensor line 
and capacitor 74 tinis lowering its voltage during diat time. StepDn is tiien mmed off. A short 
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time later the SUp control signal goes inactive, storing the measured voltage on capacitor 74. 
Hiat ends the discharge cycle. 

Next, the ResetDn control signal becomes active and shorts the sensor line to ground. 
Simultaneously the SDn and CUhi control signals become active and connect capacitor 80 
between ground and the sensor line. Capacitor 80 is discharged to ground, guaranteeing that the 
following chai;ge up cycle always starts from a known state. 

The charge up cycle starts after ResetDn control signal becomes inactive and the 
StepUp control signal becomes active. At this point the current charging source, MOS 
transistor 94, is connected to the sensor line and supplies a constant current to charge the sensor 
line by increasing the voltage dierepn. The StepUp control signal is active for a set amount of 
time (preferably equal to the time for the previously mentioned cycle) allowing the capacitance to 
charge, and then it is turned off. The SDn control agnal then goes inactive, leaving the 
measured voltage across o^Mcitor 80. 

The averaging cycle now starts. Firsttiie voltage on capacitor 80 is level shifted. This is 
done by the CbDn control signal going inactive, letting one plate of the capacitor 80 float Then 
die ChUp control signal goes active, connecting the second plate of the capacitor to Vop- Then 
titt Shane control signal becomes active which amnects the first plate of capacitor 80 to OMtpvt 
node 76, thus placing capacitors 74 and 80 in parallel This has the effect of averaging die 
voltages across die two capacitors, tiius subtracting out common-mode noise as previously 
described. This average voltage is also then available on output node 76. 

TTiose of ordinary skill in the art will recognize dut the environmental ahemating current 
and other low frequency noise-canceling feature inherent in die averaging of the voltages obtained 
in die discharge and charge cycles is most effective when die two cycles are perfonned very close 
togedier in time. According to die present invention, die ChDn and ChUp signals should be 
asserted witii respect to each odier within a time period much less dian a quarter of die period of 
die noise to be canceled in order to take advantage of diis feature of die present invention. 

According to die present invention, two different drive/sense mediods have been 
disckwed. TT>ose of ordinary skiU in die art wiU readily observe diat die charge integrator circuit 
44 disclosed widi refierence to FIGS. 4a, 4b. andS is adaptabte to operate accordmg to eidier 
scanning mediod disclosed herein. 

As is clear from an understanding of die operation of charge integrator circuit 44, its 
output voltage is only available for a short period of time and is subject to environmental noise. 
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In order to minimize the effects of noise, a switched capacitor filter circuit 48 is used. Referring 
now to FIG. 6, a schematic diagram of an illustrative switched capacitor filter circuit 48 which 
may be used in the present invention is shown. Those of ordinary skill in the art will recognize 
this switched capacitor filter cin:uit. which comprises an i^^^ 120, a pass gate 122 having 
a control input driven by a Sample control signal, a capacitor 124 connected between the output 
of the pass gate 126 and a fixed voltage such as ground, and an outpm 
common connection between the capacitor 124 and flie ou^t of the pass gate 126. In a ^cal 
embodiment, c^iacitor 1 16 will have a capacitance of about 10 pF. 

As will be appreciated by persons of ordinary sldll in the art, the switched capadtor filter 
48 is in part a sample/hold circuit and has a filter time constant which is K times the period of 
sample, wheie K is the ratio of capacitor 124 to the sum of capacitors 74 and 80 of the charge 
integrator circuit 44 of FIGS, 4a and 4b to which it is connected: The switched capacitor filter 
circuit 48 further reduces noise injection in the system. In the piefened embodiment, K = 10/2 = 
5. Tliose of ordinary sldU in the art wiU recognize that ofl^ 
filters, may be employed in the present invention, 

Refening now to FIG, 7, a more detailed block diagram of a presently prefeired 
arrangement of A/D converters 52 of FIG. 3 is presented. TTiere are fewer A/D converters than 
there arc lines in the touch sensor anay, and the inputs to the A/D conver^^ 
share each of the individual A/D converters among several lines in the touch sensor airay . The 
arrangement in FIG. 7 is more efficimt in the use of integrated circuit layout aiea than providing 
individual A/D converters for each input line. 

In the embodiment illustrated in FIG. 7, twenty-four conductive line traces arc assumed 
for the sensor array 10 of HGS. 2a-2d. As shown in HG. 7, the outputs of sample/hold circuits 
50-1 through 50-24 are fed to the analog data inputs of analog multiplexer 130. Analog 
multiplexer 130 has six outputs, each of wdiich drives the input of an individual A/D converter 
52-1 throu^ 52-6. The internal ainuigemait of analog multiplexer 130 is such that four different 
ones of die inputs arc multiplexed to each of the cu^uts. Analog multiplex^ 130 has been 
conceptuaDy drawn as six internal multiplexer blocks 132-1 through 132-6. 

In the example shown in FIG. 7, inputs taken from sample/hold circuits 50- 1 through 50- 
4 arc multiplexed to the output of internal multiplexer block 132-1 which drives A/D convener 
52-1. Similarly, inputs taken from sample/hold circuits 50-5 through 50-8 arc multiplexed to the 
output of internal multiplexer block 132-2 which drives A/D converter 52-2; mputs taken from 
sample/hold circuits 50-9 through 50-12 arc multiplexed to the output of internal multiplexer 
block 132-3 which drives A/D converter 52-3; inputs taken from sample/hold circuits 50-13 
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through 50-16 arc multiplexed to the output of internal multiplexer block 132-4 which drives A/D 
converter 52-4; iiqtuts taken from sample/hold circuits 50-17 through 50-20 are multiplexed to 
the output of iniemal multiplexer block 132-5 which drives A/D converter 52-5; and inputs taken 
from sample/hold dicuits 50-21 through 50^24 are multiplexed to the output of internal 
inultiplexer block 132-6 which drives A/D convoler 52-6. 

Analog multiplexer 130 has a set of control inputs schematicaUy represented by bus 134. 
In the iUustrative embodiment shown in FIG. 7. each of internal multiplexors 132-1 through 132- 
6 are four-input multiplexors and thus control bus 134 may comprise a two-bit bus for a one-of- 
four selection. Those of ordinaiy skill in the art will recognize that the airangement of FIG. 7 is 
merdy one of a number of specific solutions to the task of A/D conversion from twenty-four 
channels, and that other satisfactory equivalent arrangements arc possible. 

fa a straightforward decoding scheme, multiplexors 132-1 through 132-6 will pass, in 
sequence, die analog voltages present on their first through fouitii inputs on to the inputs of A/D 
converters 52-1 through 52-6 respectively. After the analog values have settled in the inputs of 
AJD converters 52-1 through 52-6, a CONVERT command is asserted on common A/D control 
line 136 to begin the A/D conversion process. 

When the A/D conversion process is complete, the digital value representing the input 
voltage is stored in registers 138-1 through 138-6. As presendy preferred, registers 138-1 
through 138-6 may each comprise a two-word register, so that one word may be read out of the 
registers to arithmetic unit 54 white a second word is being written into the registers in order to 
maximize the speed of the system. n»e design ofsuch registers is conventional in the ait 

Referring now to HG. 8, a more detaUed block diagram of the arithmetic unit 16 is 
presented. Those of ordinary skill in the art will appreciate that arithmetic unit 16 processes 
information from both the X and Y dimensions, Le., from X input processing circuit 12 and Y 
input processing circuit 14 of FIG. 1. 

Before disclosing die structural configuration of arithmetic unit 16, it is helpful to 
understand the preferred method by which the ceniroid position of an object proximate to die 
sensor array 22 is determined according to die present invention. 

According to a presently preferred embodiment of the invention, the object position in 
eidier direction may be determined by evaluating die weighted average of Uie capacitances 
measured on the individual sense line of die sensor array 10. In die foHowing discussion, die X 
direction is used, but those of ordinary skiU in die art will recognize that die discussion applies to 
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the detennination of the weighted average in the Y direction as well As is weU known, the 
weighted average may be determined as follows: 

n. ■ 

ZixACi 
Xposition=^=i 

SAG 

i>0 



where AC, = Q - CX),. Q is the capacitance presently being measured on the ith trace and CO, is 
the value measured on that same trace at some past time when no object was present In lenns of 
these past and present capacitance measurements, the posidon can be expressed as: 

Iix(C,-COj) 
Xposition = -i^i^ 

KQ-OH) 



Using the distributive property of multiplication over addition, this expression is seen to 
be equivalent to: 



-2(ixC0/)+ £(ixCi) 
Xposidon = -tl-^ ii_ 

-1(00,0+ E (CO 

f»0 f«0 



where the negative tenns in boA the numerator and denommator are offsets and represent die 
background value of die capacitances widj no object present If die term On is used to represent 
die numerator ofiEset and die term Op is used to represent die denominator offset, Eq. 3 may be 
le-writtaias: 



-QN+ lOxCi) 

-Xposidon = '■=S.^ ^ 4^ 

-Qd+ KC) 
1-0 
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Referring now to FIG. 8, it may be seen that arithmetic unit 16 includes X numerator and 
denominator accumulators 150 and 152 and Y numerator and denominator accumulators 154 and 
156. The source of operand data for X numerator and denominator accumulators 150 and 152 
and Y numerator and denominator accumulators 154 and 156 are the registers 138-1 through 
138-6 in each (X and Y) direction of the seinsor array 22 of FIG. 1. The X and Y denominator 
accumulators 152 and 156 sum up the digital results from die A/D convereions. The X and Y 
numerator accumulators 150 and 154 compute the weighted sum of the input data rather than the 
straight sum. Accumulators 150. 152. 154. and 156 may be configured as hardware elements or 
as software running on a microprocessor as will be readily understood by those of ordinaiy skill 
in the an. 

As may be seen from an examination of FIG. 8, numerator accumulator 150 and 154 
compute the expression of Eq. 4: 

D 

and denominator accumulators 152 and 156 compute the expression of Eq. 4: 
ICi 



[Eq.6] 



The contents of X and Y numerator and denominalor offset legistos 158, 160, 162, and 
164 are subtracted from die results stored in the accumulators 150, 152, 154, and 156 in adders 
166, 168, 170, and 172. Adder 166 subtracts die offset Onx stored in X numerator ofifset 
register 158. Adder 168 subtracts the offset Opx stored in X denominator offset register 160. 
Adder 170 subtracts the offset Ony stored in Y numerator ofiiset register 162. Adder 172 
subtracts the offset Ody stored in Y denominator offset register 164. The numerator denominator 
pairs are divided by division blocks 174 and 176 to produce the X and Y position data, and the X 
and Y denominator pair is used by block 178 to produce Z axis (pressure) data. The function 
performed by block 178 will be disclosed later herein. The offsets Odx. O^x. Ody, and Qny arc 
sampled firwn the accumulator contents M*en directed by calibration unit 180. 

PersOTs of ordinary skiU in the art will readUy appreciate that the architecture of the 
system of die present invention may be distributed in a number of ways, several of which involve 
the availability of a microprocessor, whether it be in a host computer to which the system of the 
present invention is connected or somewhere between ifae integrated circuit described herein and a 
Jiost computer. Embodimwits of the present invention are contranplated wherein the accumulated 
numerator and denominator values representing the summation terms are deUvered to such a 
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micioprpcessor along with the On and 0^ of&et values for processing, or where all processing is 
accomplished by a programmed microprocessor as is known in the art 

LutiaUy, the numerator and denominator accumulators 150, 152, 154, and 156 arc set to 
zero during system startup. If the multiplexed A/D converters as shown in HG. 7 are 
employed, the digitized voltage data in the first word of register 138-1 (representing the voltage at 
the oulpat of sampleAiold dicuit 50-1) is added to the sum in the accumulator and the result 
stored in the accumulator. In succession, the digitized voltage vahies stored in the first word of 
registers 138-2 through 138-6 (representing the voltage at the outputs of sample/hold circuits 50- 
5, 50-9. 50-13, 50-17, and 50-21, respectively) arc added to the sums in the accumulators and 
the results stored in the accumulators. As previously mentioned, A/D converters 52-1 through 
52-6 may at this time be convening the voltages present at the outputs of sample/hold circuits 50- 
2, 50-6. 50-10. 50-14, 50-18, and 50-22 and storing the digitized values in the second words of 
registers 138-1 throa^ 138-6 leqiectivdy. 

Next, in succession, the digitized yolta^ values stored in the second words of regiaers 
138-1 through 138-6 (representing the voltage at the outputs of-sample/hold circuits 50-2, 50-6, 
50-10, 50-14, 50-18, and 50-22, respecUvdy) are added to the sum in the accumulator and the 
result stored in the accumulator. 

Next, in succession, the digitized voltage values stored in the first wonJs of registers 138- 
1 duoagh 138-6 (v^resenting the voltage at die outputs of sample/hold circuits 50-3, 50-7, 50- 
11, 50-15, 50-19. and 50-23, rBq)ectively) are added to the sum in the accumulator and the result 
stored in the accumulator, followed by digitized voltage values stored in the second words of 
registers 138-1 through 138-6 (representing the vdtage at the outputs of sample/hold circuits 50- 
4, 5Q-i, 50-12, 50-16, 50-20. and 50-24. respectively). 

At this point in time, the accumulatMs hold the sums of all of the individual digitized 
voltage values. The digital values Stored in the On and Od ofifset registers 158. 160, 162, and 
164 are now restively subtracted from the values stored in the num»ator and denominator 
accumulators. Hie division operation in dividers 174 and 176 then completes the weighted 
average computation. 

llie divia(m operation may also be perfwmed by ah external micn>|mx»ssor vtAu^ 
fetch the vahies stored in the accnmidators or perform the accumulations itself. As the On and O^ 
-ofEset values arc presentty derived by an external microprocessor, the additional processing 
overhead presented to such external microprocessor by tiiis division qieiation is minimal. 
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Alternately, a dedicated microprocessor may be included on chip to handle these processing tasks 
without departing from the invention disdosed herein. 

The above disclosed processing takes place within about 1 miUiseoond and may be 
repeatedly perfotmed. Cunent mouse standards update position information 40 times per 
second, and thus the apparatus of the present invention may easily be operated at this repetition 
rate. 

Because of the nature of the method employed in the present invention, an opportunity 
exists to provide additional noise immunity without requiring additional hardware in the system 
of the pres«it invention. While it is aj^arcnt that after the above-disclosed sequence has been 
performed, the accumulators may be cleareid and the process repeated, the values may also be 
allowed to remain in the accumulators. If diis is done, an averaging function may be 
implemented to fimher filter out noise. According to this aspect of the invention, a number of 
sanq>les are takm and run through the accumulators without clearing them at the end of the 
processing sequence. As presently preferred, twenty-five samples are processed before a single 
division result is taken for use by the system, thus greatly reducing the effects of transiat system 
noise spikes. Those of ordinary skill in the art wiU recognize that the number of sainples taken 
prior to clearing the accumulators is a matter of design choice dictated by factors such as data 
acquisition rates, data processing rates etc. 

It is preferabte to provide additional filtering of the X and Y position data pitxiuced by 
division blocls 174 and 176 of the arithmetic unit 16 of HG. 8. The filtering preferably occurs 
in between arithmetic unit 16 and motion and gesture units 18 and 20 of FIG. 1. The X and Y 
coordinates are separately filtered as independent numbers. Each filter is an averaging register 
computing a "running average" as is weU-known in the art When the finger's presence is first 
detected, the filter register is initialized widi the current quotient In subsequent samples, the new 
quotient is averaged with the filter register value to produce a new filter register value. In the 
prcsendy preferred embodiment the values are equally weighted in the average, though different 
weightings can be used to provide stronger or weaker filtering. The sequence of values in the 
filter register serve as the X and Y coordinates used by the motion and gesture units 18 and 20 of 
HG. 1. 

The system of the present invention is adaptable to changing conditions, such as 
component aging, changing capacitance due to humidity, and contamination of die touch surface, 
etc. In addition, the present invention effectively minimizes ambient noise. According to tiie 
present invention, tiiese effects are taken into consideration in three ways. First tiie offset values 
and Od are dynamically updated to accommodate changing conditions. Second, a servo- 
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feedback circuit is provided to detennine the bias voltage used to set the bias of the charge- 
integtator circuits 44-1 through 44-n. Third, as previously disclosed herein, the reference 
voltage points for V,^ and V^^ ofthe AID converters are also dynamically altered to increase 
the signal to noise margin. ' ' 

Referring now to HG. 9, a block diagram of a calibration unit 150 which may be used 
with the arithmetic unit of HG. 8 is presented. TTie caUbration unU 150 executes an algorithm to 
establish the numerator and denominator offeet values by attempting to determine when no finger 
or other conductive object is proximate to the touch sensor anay 22. 

As previously disclosed, the O^, and Op offset values represent the basdine values ofthe 
anay capacitances with no object present. These values are also updated according to the present 
invention since basdine levels which are too low or too high have the effect of shifting the 
apparent position of tiie object depending on the sign of the error. These values are established 
by sdection of the values lead w*en no object is present at the sensor array 22. Since there is no 
external way to "know" when no object is present at sensor array 22, an algorithm according to 
anotho- aspect of the present invention is used to estiiUish and dynamically update these offset 
values. When the caIibrati(Mi unit sees a Z value which appears typical of the Z values when no 
finger is present, it instructs the offset registers (158, 160. 162, and 164 of HG. 8) to reload 
from the current values of die accumulators. According to a presentiy preferred embodiment of 
die invention, the decision to update the offset values is based on the behavior of tiie sensor amy 
20 22 in only one of die X or Y directions, but when the decision is ma<te all four offsets (Onx, 

Odx. Ony. and Ooy) are updated. In otiier embodiments of die invention, Uie decision to update 
may be individually made for each direction accordmg to die criteria set forth heidn. 

lite calibration algoridon works by monitoring changes in a selected (me of the 
denominator accumulator vatoes. Accwding to die present invention, it has beoi observed that 

25 the sensitivity to chmges in capacitance of one of the sets of conductive lines in the touch sensor 
array 22 is greater than die sensitivity to changes in ciqiacitance of die odier one of the sets (tf 
conductive lines in die touch sensor array 22. Experience suggests diat die set of conductive 
lines having die greater sensitivity to c^acitance changes is die one which is physically located 
above die conductive lines in die oOier i-rection and dierefore closest to die touch surface of die 

30 sensor array 22. The upper set of conductive lines tends to partially shield die lower set of 
conductive Unes finom capacirive changes occurring above die surface of die SMisor array 22. 

The finger pressure is obtained by summing dte capacitances measured on die srase lines. 
This value is already present in die denonunator accumulator after subtracting die offset Od. A 
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finger is present if the pressure exceeds a suitable threshold value. This threshold may be chosen 
expoimentalfy and is a function (tf suifiu»inatBiial and dim The threshold may be 

adjusted to suit the tastes die individual user. 

llie pressure rqwited by the device is a ample function f(Kj^ Yq) of the denominators 
for the X and Y directions as implemented in block 178 of FIG. 8. Possible functimis include 
choosing one preferred denominator value, or summing die denominators. In a presently 
prcfored embodimoit, die smaller of die two denominators is chosen. This choice has die 
desirable effect of causing the pressure to go below the direshold if the finger moves slighdy off 
the edge of the pad, where the X sensors are producing valid data, but the Y sensors arc not, or 

viseversa. This acts as an electronic bezel which can take die place (rf a mechanical bezel at the 
periphery of the sensor area. 

In die example of FIG. 8, the Y denominator is chosen for monitoring because it is die 
most sensitive. The chosen denominator is referred to as Z for die puiposes of die <»libration 
algoridun. The current saved offset value for diis deiwminaior is referred to as Qz- 

The goal of die cidibradon algorithm is to track gradual variadons m dtt 
while making sure not to caUbrate to die finger, nor to calibrate to mstantaneous spikes arising 
firom noise. As will be apparent to diose of ordinary skill in die art from die following 
disclosure, die calibration algoridun could be implemented in digital or analog hardware, or in 
software. In a current embodiment actually tested by die inventors, it is implemented in 
software. 



As Z values arrive in die calibration unit, diqr are passed dirough filter 182. Ffistory 
buffer 184. which operates in conjunction widi filter 182, keeps a "running average" of recent Z 
values. When a new Z value arrives, die current running average is updated according to die 
formula: 

newFz = a(oki F2) + (l.a)Z jEq 7 

where a is a constant factor between 0 and 1 and typically close to 1 and Z is die current Z value. 
In die preferred embodiment, alpha is approximately 0.95. Hie intention is for Fg to change 

slowly enough to foUow gradual variations, widiout being gteafly affected by short perturbations 
inZ. 
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The filter 182 receives a signal ENABLE from control unit 186. ITie running average Fz 
is updated based on new Z values only when ENABLE is asserted. If ENABLE is deasserted, 
F2 remains constant and is unaffected by current Z. 

The history buffer 184 records the several most recent values of F^. In the present 
5 embodiment the history buffer records the two previous F^ values. The history buffer might be 
implemented as a shift register, circular queue, or analog delay line. When the history buffer 
receives a REWIND signal from control unit 186, it restores the current running average F^ to 
the oldest saved value. It is as if the filler 182 were "retroacdvely** disabled for an amount of 
time corresponding to the depth of the histcMy buffer. The purpose of the history buffer is to 
10 permit such retroactive disabling. 

The current running avOTge Fz is compared against die current Z vdue and t^ 
of&et Qz by absolute difference units 188 and 190, and comparator 192. Absolute difference unit 
188subtractsthevalucsZandI^andoutputstheabsohitevalueoftheirdiffei^ Absolute 
difference unit 1 90 subtracts the values Oz and Fz and ouQ>ut5 the absolute value of their 

1 5 dififcrence. Comparator 192 asserts the UPDATE signal if ifae output of absolute difference unit 
1 8 8 is less than the output of absolute difference unit 190, i^ , if II^ is closer to Z than it is to 
Oz- T1»IM>ATE signal wiU tend to be asserted when the mean value of Zs 
restinglevel. It wiU tend not to be asserted when Z makes a brief excursion away fip 
normal resting level The filter constant a determines the length of an excursion yAiich will be 

20 considered "brief for this purpose. 

Subtracter unit 194 is a simple subtracter that computes the signed difference between Z 
and Oz- This subtracter is actually redundant with subtracter 172 in figure 8, and so may be 
merged with it in the actual implementation. The output Cz of this subtractor is the calibrated Z 
value, an estimate of the finger pressure. This pressure value is compared against a positive and 
25 negative Z threshold by comparators 196 and 198. These thresholds are shown as Znj and -Zm, 
althcmgh they are not actually required to be equal in magnitude. 

If pressure signal Cz is greater than 2^, the signal FINGER is asserted indicating the 
possible presence of a finger. The Zm threshold used by the calibration unit is similar to that 
used by the rest of the system to detect the presence of the finger, or it may have a different 
30 "Value. In the present embodiment, the calibration Zih is set somewhat lower than the main Zjh 
to ensure that the calibration unit makes a conservative choice about the presence of a finger. 
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If pressure signal C2 is less than • Z^. the signal FORCE is asserted. Since is meant 
to be equal to the resting value of Z with no finger present, and a finger can only increase the 
sensor cqncitance and thus the value of Z, a largely negative C2 implies that the device must 
have inconectly calibrated itself to a finger, which has just been removed. Calibration logic 200 
uses this fact to force a recalibration now that the finger is no longer present 

Control logic 186 is responsible for prevaiting running average from being infhienced 
by Z values that occur when a finger is piesoit. 6aq)ut ENABLE is generally off when the 
FINGER signal is true, and on when the FINGER signal is false. However, when FINGER 
transitions from false to due, the control logic also pulses the REWIND signal Whoi 
FINGER transitions from true to false, the control logic waits a short amount pf time 
(comparable to the depth of the history buffer) before iasserting ENABLE. Thus, the running 
average is prevented from foflowing Z whenever a finjgeris present, as weU as for a short time 
before and after the finger is present 

Calibration logic 200 produces signal REGAL ftom the outputs of the three comparators 
192, 196, and 198. When REGAL is asserted, the ofEset registers C^, and Od wiU be reloaded 
fiom the current accumuhitor valiies. REGAL is produced fiom the following logic equation: 

RECAL s FORCE or (UPDATE and not FINGER). [Eq. g] 

In addition, calibration logic 200 arranges to assert RECAL once when the system is 
first initialized, possiWy after a brief period to wait for the charge integrators and other circuits to 
stabilize. 

From the descriptions of control logic 186 and calibration logic 200. it will be apparent to 
tho« of ordinary skill in the art that these blocks can be readily configured using conventional 
logic as a matter of simple and routine logic design. 

It should be obvious to any person of ordinary skiH in the art that the calibration algorithm 
described is not specific to the particular system of charge integrators and accumulators of the 
current invention. Rather, it could be employed in any touch sensor which produces proximity or 
pressure data in which it is desired to mainuun a caUbration point reflecting die state of the sensor 
when no finger or spurious noise is present 

Referring now to FIG. 10, a bias voltage generating circuit 46 useful in the present 
invention is shown in schematic diagram form. According to a presendy preferred embodiment 
of the invention, all of the bias transistors 108 (FIG. 4b) of charge integrator circuits 44-1 
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through 44-n have their gates connected to a single source of bias voluge. although persons of 
ordinary ddU in the art recognize that other arrangements are possible. There are a number of 
ways in which to generate the bias voltage required by charge integrator circuits 44-1 through 4- 

As may be seen from an ocamination of HG. 10, the bias voltage geneiatmg drcuit ^ 
an overdamped servo ^stem. A reference source which approximales the current SQun» 
function of a typical one of the charge integrator circuits 44-1 through 44-n includes a capacitor 
202 having one of its plates grounded. The othetone of its plates is connected to the Vdd power 
supply through a first pass gate 204 and to a current source transistor 206 dirough a second 
passgate 208. A fflter circuit 210, identical to the fUter circuits 48-1 through 48-n and controlled 
by the samesignal as filler circuits 48-1 through 48-n is connected to sample the voltage on 
cq»cttor 202 m die same manner that the filtw-and-sample/hold circuits 48-1 through 48-n 
sample die voltages on die sensor conductor c^)acitances in the sensor array 22. 

Tte output of filter circuit210 is fed to die wm-mvcrting ii^)ut of a weak 
transconductance amplifier 212, having a bias current in d>e range of from about 0.1-0.2MA. The 
inverting input of die transconductance amplifier 212 is connected to a fixed voltage of about 1 
volt generated, for example, by diode 214 and resistor 216. The output of transconductance 
anq>Iifier 212 is shunted by capacitor 218 and also by cj^tor 220 dirough passgate 222. 
Capadtor 220 is chosen to be much larger dian capacitor 21 8. In a typical embodiment of tiie 
present invention, capacitor 218 may be about 0.2pF and capacitor 220 may be about lOpF. 

Capacitor 220 is coniwcted to die gale of N-Channel MOS transit 224, whidi has its 
drain connected to die drain and gate of P-Channel MOS transisto- 226 and its source connected 
to die drain and gate of N-Channel MOS transistor 228. The source of P-Channel MOS 
transistor 226 is connected to and die source of N-Channel MOS transistor 228 is connected 

to ground. The common drain connection of transistors 224 and 228 is die bias voltage output 
node. 

An opdimal passgate 230 may be connected between a fixed voltage source (e.g., about 2 
volts) and capacitor 220. Passgate 230 may be used to initialize die bias generating circuit 46 on 
startup by charging capacitor 220 to the fixed voltage. 

During each sample period, die filter circuit 210 takes a new sample. If die new sample 
„ili£fei5 from the previous sample, die output voltage of transconductance amplifier 212 will 
change and start to charge or discharge capacitor 218 to a new voltage. Passgate 222 is switched 
on for a shon time (i.e., about l^sec) and die voltages on capacitors 218 and 220 try to average 
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diemselves. Due to die large size differenoe between ci4>acitots 218 and 220. capacitor 218 
cannot supply enough chaige to equalize the yoltagie during the period when passgate 222 is 
open. This anangement prevents large changes in bias voltage ftom cycle to cycle. 

Capadtor 202 shodd lode as much as possible like one of the soisor array diannels and 
has a value equal to die bMdcgroimd a^acitance of a typical sensor line, (ix., with no o 
proximate or present c^acitance component). Capacitor 202 may be formed in several ways. 
CapadtOT 202 may comprise an extra sensor line in a part of the sensor array, configured to 
approximate one of the active sensor lines but shielded from finger c^acitance by a ground 
plane, etc. Alternately, capacitor 202 may be a capacitor formed in the integrated circuit or 
connected thoeto and having a value selected to match diat of a typical sensor line. In this 
respect, the signal source comprising capacitor 202 and filter circuit 210 is somewhat like the 
drcuidy for generating the and reference voltages, in diat it mimics a typical sensor 
line. 

As another alternative, one of die actual sensor lines may be employed to set die bias 
voltage. Th& measured voltage on die two end-point sensor lines may be compared and die one 
having die lowest value may be selected on die dieory diat, if a finger or odier object is proximate 
to die sensor array, it wiD not be present at sensor lines located at die opposite edges of die array. 

According to anodier aspect of die present invention, an "edge motion" feature may be 
impkmented when die object position sensor of die present inventicm is used as a computer 
cursor control device in place of a mouse. A practical problem arises in die use of computer 
mice or odier cursor control devices vAiea an attempt is made to move an object over a large 
distance on a computer screen. This problem is encountered when a small mouse pad is used 
widi a computer mouse, or when an object position sensor of die kind described herein has a 
small touch sensor area. 

In touch sensor applications, diis problem is especially acute during a "drag" gesture. If 
die user lifts die finger to begin a second sttoke, die drag effect ends prematurely on die screen. 
Hie edge motion feature of die present invention helps to eliminate die need to use ^wing," or 
multi|de smdcBS of die finger to move a large distance on die screen. 

A prior sohition to die long-distance drag problem has been to provide an acceleration 
feature, Le., a "ballistic" curve, where die gain varies as a fimction of finger speed, aUowing the 
user to move long distances, albeit clumsily, using a repeated finger swishing motion. This 
technique can be used widi any variable-speed pointing device, for example, widi a mouse on a 
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mouse pad of limited aze. Typical mouse driver software includes an adjustable acceleration 
feature (sometimes under a misleading name like "mouse speed"). 

According to a pfcsently preferred embodiment of the invention, the edge motion feature 
of the object position sensor is implemented by motion unit 18 of FIG. 1 and works by defining 
two zones in the sensing plane 10 containing the touch sensor array 22. As shown in HG. 1 1 , 
the sensing plane 10 is preferably divided into ah inner zone 240 comprising most of the central 
portion of the surface of sensing plane 10 and an outer zone 242, typwally comprising a thin 
marginal area at the periphery of the sensor array. The center of the sensing plane lOmaybe 
described as the origin (X,^ Y^) in a cartesian coordinate system. Those of ordinary skiU 
in the art will recognize however that the inner and outer zones could be of any shape. 

Thus in HG. 1 1, inner zone 240 is defined by the upper dashed line Yo, right-hand 
dashed line Xo, lower dashed line -Yq and left-hand dashed line -Xq. Outer zone 242 is the 
region between the outer edges of die sensing plane 10 defined by Yn„, 
"Ynua. and -X^ and the outer borders of inner zone 240 defined by Yq, Xo, - Yq, and - 

According to this aspect of the present inventirai, finger motions in the inner zone 240 are 
translated in the standard Cushion into motion events to be sent to the host computer. As is well 
understood in the art, the standard way to communicate moose motion to a host computer may 
also be anployed in the present invention to communicate finger motion to a host computer. 
After Lhe fmger position is established as disclosed henan, the information communicated to the 
host compute is: 

AX = A(Xcur - Xou) [Eq. 9] 

AY - A(Y^ - Yom) jgq jqj 

where AX is the change in the X position of the finger, AY is the change in the Y position of the 
finger, X^^ is the currentX position of the finger and X^^ « the last reported X position of the 
finger, Y^. is the current Y position of the finger and Y^m is the last reported Y position of the 

finger, and A is a "gain factor" which is commonly encountered in mouse cursor control 
applications. 

TypicaUy, the host computer takes (AXw^Y) evwits and moves the cursor by die indicated 
amount in each axis, thus reconstructing dte finger position on die screrai as the suoceKive AX 



36 



wo 97/36225 PCTAJS97/05333 

and AY values are accumulated. So far, this is standard cursor control behavior where edge 
motion is not considered. 

According to the present invention, when the finger is reported as being in the outer zone 
242, the edge motion feature of the present invention may be enabled. The detennination of 
whether the finger is in the outer zone is a simple detennination:. 

[-Xo < < XJ is FALSE, OR [-Yo<Y^<Yol is FALSE [Eq. 11] 

Referring now to FIG. 12A, a circuit 244 for making a determination of whedier a finger 
is in the outer zone 242 is shown in schematic diagram form. FIG. 12A illustrates a hardware 
^bodiment for detBrmining whether a finger is in the outer zone 242, but those of ordinaiy skill 
in the art wiU readily recognize that this detennination couM leadUy be made by p^ 
of a number of equivalent software routines. Such software routines are obvious and 
stndghtfoiward from the functions described herein. 

Circuit 244 includes digital comparators 246, 248, 250, and 252, whidi may be 
straightforwardly implemented by conventional logk;. Comparator 246 puts out a true signal 
when die quantity X^,, at one of its inputs is greater than die fixed quantity Xq presoited to its 
other input Comparator 248 puts out a tnie signal when the quantity X^, at one of its inputs is 
less than the fixed quantity -Xo presented to its other input Comparator 250 puts out a true 
signal when thequantity Y^^ at one of its inputs is greater than the fixed quantity Yq presented to 
its other input Comparator 252 puts out a tnie signal when the quantity Yea one of its inputs 
is less than the fixed quantity -Yq presented to its otho: input. 

The outputs of comparators 246, 248, 250, and 252 are ORed together by OR gate 254. 
As will be appreciated by those of ordinary skill in the art, the FingeiOuter signal output of OR 
gate 254 is true only when the necessary conditions of Eq. 1 1 are satisfied. 

It is presendy preferred that the edge motion aspect of the present invention may be 
selectively enabled or disabled by a user. When the edge motion feature is enabled and the finger 
is rqported as being in die outer zone as set forth above, a second componrait is added to the 
(AX,AY) events rq»tted: 

_AX =A OCcm - Xoid)+ S(Xcur - Xcenier) [Eq. 12] 

AY = A(Y^-Y„u)+S(Y^- Ye«ter) ^gq. 13] 
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Where is the X coordinate of the center of the pad, Y^„^, is the Y coordinate of the center 
of the pad, and S is a multiplicative factor for speed. S should be chosen such that the movement 
of the cursor is at a comfortable speed on the display screen. 

For example, if the finger is held a good distance to the right (so that X^^ > Xo), then the 
cursor vdU tend to "gUde" to the right at a constant speed set by multiplicative speed fartor S in 
Eqs. 12 and 13. Hiis factor can be adjusted to individual taste of a user. 

If the sensor array has different dimensions in X and Y, it is useful to set the 
multiplicative speed factor S parameters in the X and Y directions to differ by the same ratio as 
the pad dimensions, so that a finger held at the left or right edge of the sensor array will produce 
the same cursor speed as a finger held at the top or bottom edge. In the preSenUy prefened 
embodiment of the sensor array, there are 24 X traces and 18 Y traces. Hieiefore. since X is 4/3 
wider than Y (24 traces vs. 18 traces), the X multipUcative speed factor Sx is set to be to be 3/4 
as large as dte multq>licative qwed factor Sy. 

Hie glide speed of the cursor during edge motion is cleariy a diiea function of the 
distance of the finger fiom the center of the pad. and the gjide direction is equal to die direction of 
the finger from the center. If the outer zone has the piefened "edge margin" shape as shown in 
FIG. 1 1. then the finger will always be roughly the same distance from the center whenever edge 
motion is activated (within a factor of the square root of 2 = 1.41, assuming a square pad). 
Hius, the psychological effect is that edge motion involves a constant gUde speed wteie die 
direction is set by the position around the sensor array edge. 

The square root of 2 variation may be canceled out by dividing the edge motion tenns in 
equations (12 and 13) by a normalizing factor of die fwm: 



V - Xcenter)^ + C^car " Ycenter)^ 



[Eq. 14] 



but this is a computationally intensive step applied to fix a problem that is barely noticeable to the 
average user, dius. it may be (nnitted. 

As discussed above, when a finger is in the outer zone, the FingerOnter signal, which 
is a global signal forboUi theX and Y axis, is made true, and increments ate added to the (AX, 
-AY) events pursuant to Eqs. 12 and 13. Because increments corresponding to S(X„ - X^) 
and S(Yc„ - Y^^^) are added in die X and Y directions, respectively, for the (AX. AY) events. 
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the direction of the cursor motion will be along a vector from the center of the pad to the finger 
position. In graphical enviromnents. there are many vertical and horizontal objects and use of 
edge motion may incur some unintended results. For example, if a user in a graphical 
enviionment pulls down a tall pop-up menu; the uso- may need the assistance of the edge motion 
feature to reach the bottom of the menu. In this caise. however, the direction of the cursor motion 
may cause the cursor to slide off the pop-ip rami, when the user actually wants the cuisor to 
move in a vertical motion along the Y axis. 

In another embodiment of the edge motion feature of the present invention, the direction 
of the cursor motion will be orthogonal to the edge motion boundaiy Uie finger has crossed in 
travding to the outer zone. 

For example, when a finger crosses either of the edge motion boundaries conesponding 
to die X axis (die right and left edges of the totichpad) and travels into the outer zone, the 
direction of cursor motion due to the wthogonal ed^ motion feature will be only along die X 
axis. Any cursor motion in die Y direction while die finger is in die outer zone conesponding to 
die X axis will occur in a nonnal fashion, i.e. not according to an edge motion feature. 
Analogously, when a finger crosses eitiier of die edge motion boundaries corresponding to die Y 
axis (die top and bottom edges of die touchpad) and travels into the outer zone, die direction of 
cursor motion due to die edge motion feature will be only along die Y axis. Any cuisor motion in 

die X direction while die finger is in die outer zone corre^nding to die Y axis will occur in a 
noimal fashion, Le. not according to an edge motion feature. It should be appreciated, however, 
diat when die finger enteis into any of die four comers of die pad, dius crossing bodi X and Y 
edge motion boundaries, edge motion will essentially be along a vector from die crater of die pad 
to the fingo- in the coma-. 

Unlike die edge motion feature which uses a global FlngerOuter signal to indicate diat 
die finger is in die outer zone, die orthogonal edge motion feature has two signals. One is X 
FlngerOuter and die odier is Y FlngerOuter. X FingerOuter is true when a finger crosses 
eidier of die boundaries corresponding to die X axis, which in die prefened embodiment are on 
die right and left edges of die touch pad, and Y FingerOuter is true when a finger crosses eidier 
of die boundaries corresponding to die Y axis, which in die prefened embodiment are on die top 
and bottom edges of die touch pad. 

In FIG. 12B, a schematic is shown of die hardware used in malting die deteimination of 
whedier a finger is in die outer zone according to die ordiogonal edge motion feature. It will be 
appreciated by diose of ordinary skiU in die art duit die circuit shown in FIG. 12B could be 
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implemented with an equivalent software routine. Where it is appropriate, FIG. 12B uses Che 
same reference numerals shown in FIG. 12A. 

Referring now to HG. 12B, circuit 256 includes digital compaiators 246, 248, 250 and 
252 which may be implemented by conventional logic, Comparator 246 puts out a true signal 
when the quantity X„ at one of its inputs is greater than the fixed quantity Xq piesented to its 
other input Comparator 248 puts out a true signal wh«i the quantity X^^^ at one of its inputs is 
less than the fixed quaiitity -X© presented to its other input Comparator 250 puts out a true 
signal when the quantity at one of its inputs is greater than the fixed quantity Yq presented to 
its other input Comparator 252 puts out a true signal when the quantity at one of its inputs 
is less than the fixed quantity -Yq presented to its other input 

Hie outputs of comparators 246 and 248 are ORed together by OR gate 258. When the 
condition satisfied by: 

-Xo<Xeur<Xo is FALSE 

a TRUE signal, X HngcrOuter, win be output fixim OR gate 258. 

Hie outputs of con^)arators 250 and 252 are ORed together by OR gate 260. When the 
condition satisfied by: 

-Yo<Y^„<Yo is FALSE 
a TRUE signal, Y FingerOater, will be output from OR gate 260. 

Accordingly, an X FlngerOuter signal will result in a value being added to the AX event 
in an amount determined by SQi^ - X^j^^) as set out in Eq. 12. However, because the only 
time this component will be added is y/bcn an X axis edge motion boundary has been crossed, 
i.e. no additional component determmed by S(K^ - X,^) is added to the AX event when only 
a Y axis edge motion boundary has been crossed, the component added to the AX event will be 
approximately constant because X^ - is approximately constant 

A Y FlngerOuter signal will result in a value being added to the AY event in an amount 
determined by S(Ycai - ^ccnux) ^ set out in Eq. 13. However, because the only time this 
component will be added is when a Y axis edge motion boundary has been crossed, i.e. no 
additional component determined by S(Y^ - Y^^) is added to the AY event when only an X 
_axis edge motion boundary has been crossed, the component added to the AY event will be 
approximately constant because Ycu, - Y^^ is approximately constant 
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Accordingly, the orthogonal edge motion feature permits cursor motion in only the eight 
"compass" directions. For, example, if the finger is on the left edge of the touchpad, the 
orthogonal edge motion feature causes the cursor to glide left along the X axis, since X 
FingerOuter is TRUE and Y FuigerOutef is FALSE. The same is true for the right edge of 
the pad, except die cursor will glide right along the X axis. Those of ordinary skill in the art will 
rBcogni2B the coiresponding movements for the upper and lower edges of the pad. When the 
finger is in any of the comers of the pad, X FingerOuter and Y FingerOuter are both TRUE, 
and the motion will be along a 45 degree angle (assuming a square touchpad) from the coiner of 
the pad to where the finger is placed. 

The edge motion feature of the present invention can be confusing if the user does not 
expect it Since edge motion is most useful in connection with the drag gesture, it is fvesently 
preferred to arrange for it to occur only daring a drag, i.e., only when the gesture logic is 
virtually "holding the mouse button down." Hw drag gesture and odiM^ gestures are 
implemrated by gesture unit 20 of FIG. 1. 

At times when the edge-motion function is not desired, the outer zone 242 "goes away" 
{i.e., is ignored) and die iniier zone 240 effectively expands to cover the entire sensing plane 10. 
It has been found that this is much less confusing in practice, probably because the usw is more 
likely to be consciously aware of the cursor conttol device during a drag gesture than during 
simple cursor motions. 

Assuming the preferred zone boundary shape of FIG. 1 1, the foUowing algorithm may be 
employed to implement the edge motion feature of the piesent invention: 

IFNOT(-Xo<Xe„<Xo AND-Yo<Y«.<Yo) 

AND (optionally) a drag gesture in progress, THEN 

LeteX = Sx(Xc„,-Xcenter) 

UteY = Sv(Y«,-Yee««) 

ELSE 

UteX = eY = 0. 
ENDIF 

Odierwise, For ordiogonal edge motion, the algorithm is as follows: 

IF NOT (-Xo < X„ < Xq) AND (optionally) a drag gesture in progress^ THEN 
I^teX = Sx(X«„-X^^) 
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ELSE 

LeteX = G. 
END IF - . 

IF NOT (- Yo <Ycur<^o AND (optionally) a drag gesture in progress* THEN 
5 LeteY = SY(Ye„-Y^„^) 

ELSE 

Let eY=a 
END IF 

Next, the dX and dY motion terms arc computed fiom die regular algorithm: 
10 i.e., LetdX = A(Xe„.X^,) 

LetdY = A(Ye,,.You) 

Finafly. the resultant packet (AX = dX-jcX. AY = dY-heY) is transmitted to the host computer. 
Those of ordinary skill in the art will recognize that a linear proportionality is described by the 
above equation. As used herein."proportionaUty" means that the signal generated is a monotonic 
1 5 function. Those of ordinary skill in the art wiU recognize that other monotonic f unctions> 
including but not linuted to inverse proportionality, and non-linear proportionality such as 
logarithmic or exponential functions, could be employed in the present invention widiout 
dq>arting from the principles disclosed herein. 

A hardware implemratation of this algorithm is illustrated in FIG, 13 in sdiematic 
20 diagram form. While circuit 262 is shown implemaited in the X direction only, those of 
ordinary skill in the art will recognize that an identical circuit will also be employed in the Y 
direction. Such skilled persons will also immediately appreciate the complete equivalence of 
inq>lementing the hardware solution of HG. 13 as a software routine. 

Edge-motion circuit 262 includes a subtracter circuit 264 in whid the previous value of 
25 X^ stored in delay 266, is subtracted from the present value of X^^ The output of subtractor 
circuit 264 is presented to multiplier 268, which multiplies the result by the gain factor "A". Tte 
ou^ut of multiplier 268 is die term dX. 

The term X^^ is also presented to subti:actor circuit 270 in which the value of Xceoter is 
subtracted from the present value of X^u^ Tlie output of subtractor circuit 270 is presented to 
30 multiplier 272, which multiplies the result by the gain factor "S" to obtain the value of the eX 

_tenn. It will be appreciated that with orthogonal edge motion subtractor circuit 270 and multiplier 
272 arc not required and a constant value can be provided for the eX term, whose sign is positive 

if Xcur >Xcenter negative if X^ar <Xcenter • 



42 



wo 97/36225 PCT/US97/05333 

A two-input AND gate 274 has its input tenns die value FingerOuter from the circuit of 
FIG. I2A and die value MotionEnable which is a toggled on/off enable signal for the edge 
motion feature of die present invention. • If bodi FingerOuter and MotionEnable are true, 
switch 276 Is configured to pass die output of multiplier 272 to adder circuit 278. If eidier 
FingerOuter or MotionEnable is false, dien switch 276 is configured to pass die value zero 
to adder 278. TTie output of switch 276 is die eX term. The output of adder 278 is passed to die 
host computer as AX. The MotionEnable signal can be controlled by die user, e.g., by a 
conmjl panel Alternatively, it may be controlled by die gesture unit as will be more fully 
disclosed. 

It should be appreciated diat when orthogonal edge modon instead of edge motion is 
being enabled, die two-input AND gate 274 has as its input terms die value X Fii^erOuter 
from the circuit of FIG. 12B (or die value Y FingerOuter from die circuit of FIG. 12B for die 
Y direction) and die value OrthoMotionEnabk which iis a toggled on/off enable signal for die 
edge motion feature of die presMit invention. If bodiX FingerOuter and 
OrthoMotionEnable are tnie, switch 276 is configured to pass die output of multiplier 272 to 
adder circuit 278. If eidier X FingerOuter or OrthoMotionEnable is false, dien switch 276 
is configured to pass die value zero to adder 278. The output of switch 276 is die eX teim. The 
output of adder 278 is passed to die host computer as AX. The OrthoMotionEnable signal 
can be controlled by die user. e.g., by a control panel Alternatively, it may be controlled by die 
gesture unit as win be more fully disclosed. 

In an alternate form, die dX term may be replaced by die eX leim. and likewise for dY 
and eY, when die finger is in die "oatei^ zone, radier dian adding die two terms in diat zone. This 

results in a more "pure" edge motion which is harder for die user to guide. User tests have 
shown diat die dX+eX form shown above fisels better and is eaaer to use. 

Anotiier alternative wAich is functional but has been found to be less desirable employs a 
somewhat wider outer zone. The gUdc speed is dien varied in proportion to die distance of die 
finger into die outer zone radier dian die distance from die center of die pad. Tbus, as die finger 
enters die outer zone die gUde speed starts at zero and incnjases to some reasonable limit as die 
finger reaches die edge of die pad. The result is a smoodier transition between edge-motion and 
nonnal behavior. It is not difficult to modify die above formulas to produce dus alternate 
behavior. Ibis variant was tried by die inventors because die transition into edge-motion mode 
seemed too abrupt; tests showed diat diis abruptness is actuaUy a boon in typical use. Tbe smoodi 
temsition is harder to "feel", and dius winds up being more, not less, likely to catoh die user by 
surprise, niose of ordinary skill in die art will appreciate diat a solution midway between die 
two described medwds can also be employed to produce a less abrupt transiticm. 
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Alternate solutions to the long-distance drag problem have been to provide a 'locking" 
drag or drag "extension", as will be disclosed herein. 

The edge motion feature of the present invention is used advantageously with one or more 
finger gestures which may be performed by a user on the sensor array and are recognized by the 
system. Of particular interest are the basic tap and drag gestures. The tap gesture is analogous to 
the cUcking of the mouse button on a conventional mouse, and the concept of dragging objects is 
familiar to all mouse usos. 

Pointing devices such as mice typically include one or more mouse buttons. The user can 
point and dick a button to select an object on the screen, or hold the button down and move the 
mouse to drag an object around die screen. Touch sensor pointing devices can offer "gestures," 
which are spedid finger motions that simuhte mouse button actions without the need for physical 
switches. (Since gestures may be difficult for novices or users with disabilities, it is preferable to 
provide physical switches as well) In the foUowing discussion, die word "finger" should be 
interpreted as including a stylus or odier conductive object as previously described. 

Referring back to figure 1, according to anoUier aspect of the present invention, gesture 
unit 20 examines the (X.Y.Z) data produced by arithmetic unit 16 to produce one or more "virtual 
mouse button" signals to be sent along with die (AX, AY) signals to the host 

FIG. 14 is a more detailed block diagram of gesture unit 20 of FIG. 1. According to die 
present mvention. gesture unit 20 of the present invention is capable of supporting a variety of 
gestures. Gesture umt 20 includes tap unit 280, zigzag unit 282, push umt 284. and button 
control unit 286. 

Some number of physical switches may be supported by gesoire unit 20. In the 
illustrative example of FIG. 14, two inputs A and B to button control unit 286 come from 
physical switches. Sudi switches may be mounted on die toucIq)ad module itself or jwovided 
exieraaUy. Any number of switches may be provided, or none at all. The inputs A and B have 
two states, logic and logic "1". Those of orduiary skiU m the art will recognize diat. instead 
of mechanical switches, the switch signals could be implemented by spetAaL toudi sensors, 
operated by charge integrators sunilar to units 44 which feed into tiireshold comparators to fomi 
digital signals. 

^ Tap unit 280, zigzag unit 282, and push unit 284 examme the sequence of (X,Y,Z) 
samples to look for various types of gestures. The outputs of all these units, plus the switch 
signals, are combined in button control unit 286 to produce die actual button-press signals sent to 
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the host In the illustrative example disclosed herein, the touchpad simulates a three-button (Left. 
Middle, Right) pointing device. The system of FIG. 14 could clearly be extended to support 
other gestures than those described-here, or to support fewer gestures in the interest of simplicity. 

Button control unit 286 can use any of several well-known methods for combining 
multiple signals. For example, a priority ordering can be established among the various sources, 
or each button ou^t (Left, Middle, and Right) can be asserted rclicked", "pressed" or '^dd 
down") whenever any of the sources indicate that button. Any particular method of combining 
these signals is a routine design detail dependent on a particular system configuration which may 
be easily implemented by persons of ordinary skill in the art 

In a presenfly preferred embodiment, the button control unit 286 maps both switches and 
gestures to the most commonly used virtual buttons, giving maximum flexibility to the user. In 
an alternate embodiment, switches and gestures can be mapped to different virtual buttons so that 
a larger number of virtual buttons can be covered without resort to exotic gestures. Or. the user 
can be offered a choice of mappings. 

It is wen known in the art to allow extra button switches to be processed as specialized 
commands, such as double-clicking, selecting commonly used menu items, etc.. instead of their 
normal role as mouse buttons. Similarly, the button control unit 286 or host software could map 
some of the gestures described here to software commands instead of simulating mouse buttons. 
Such processing and mapping is weU within the realm of ordinary skill in the art. 

n»e tap unit 280 decodes the most basic gestures, including taps, drags, hops, and tap 
zones. Tliese gestures are iUustnited as timing diagranis in HGS. 15a thn)ugh 15e. In each of 
FIGS. 15a through 15e. two signals arc shown graphed against time; one is the aoak>g "Z" 
(finger pressure) signal, the other is the digital "Out" (virtual button press) signal TTje various 
relevant time spans are shown with labels ""tl" through •'t21". 

Tlje basic "tap" gesture is a quick tap of the finger on the pad. Such a tap, of short 
duration and involving little or no X or Y finger modon during the tap, is presented to the host as 
a brief click of die moyse button. If a multi-button mouse is simulated, the tap gesture may 
simulate a click of the "primary" mouse button, or the button to be simulated may be user- 
selectable using a shift key, control panel, or other known means. Two taps in rapid succession 
arc presented to the host as a double click of the btitton! In general, multiple taps translate into 
multiple elides in the obvious and natural way. 
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Because it is impossible to tell whether a finger stroke wiU be a valid tap (as opposed to a 
cursor motion) while the finger is still down, the device of the presently prefened embodiment 
does not report a button click until the finger is lifted. ITus delay is not genendly noticeable to the 
user smce taps by definition are very brief strokes. 

A small amount of motion may occur during ifae tap stroke, due to such factors as the 
natural defonnationofthefingertipmMlerpressurc. Ibis can cause the virtual cKck created by the 
tap gesture to select the wrong item or location on the screen. To avoid this, either the motion 
must be suppressed untU the motion is great enough, or the duration long enough, to disqualify a 
tap. or the motion must be allowed but then retroactively canceled out once die up gesture is 

recognized. latter solution is preferable, since even a small amount of suppressed motion is 
notksabletoaieuser. 

According to the presently preferred embodiment of the invention, motion events are sent 
to the host as usual, and also recorded in a register or queue. When the tap gest^ 
a correspondmg negative amount of motion is quickly rephyed in oider to "undo" the already, 
reported motion and to restore the origimd cursor position as of moment Ifae finger's presence 
wasfirstdetected. TTie motion during the stroke may have been seat to the host in the fomi of a 
sequence of several packets. For greatest precision, this sequence can be saved and replayed in 
reverse. However, if the host's motion processing is linear, it wiU suffice to accumulate the to^ 
amountof motion duringtbestrokeaiKlsendacompensatingmotioninasinglepackeL Since 
the "accetenition" feature of a typical mouse driver activates only at high speeds, this assumption 
of Imeatity is usually safe in this context 

The inputs considered by tap unit 280 are CurPos, the current (X.Y) finger position 
from the arithmetic unit; Z. the current pressure value; and CurTlme. the current time in some 
suitable units of time (such as milliseconds or number of samples processed). 



There are nine state variables used in tap unit 280. TapState is NONE if there is i 

gesture in progress. TAP if there is a tap or drag gesture in progress, and L(X:KED if there is ; 
locking drag or drag extension in progress. TapOkay is TRUE if a high enough Z value has 
been seen in the current stroke for the stroke to qualify as a tap. DowuPos is the OC.Y) position 
at which the finger last touched down on the pad. DownTime is the time at which the finger 
last touched down. UpPos and UpTime record the position and time at which the finger last 
lifted from the pad. TapButton is one of LEFT, MIDDLE, or RIGHT, identifying whether Uie 
current gesture is simulating an action on the left, middle, or right virtual mouse button, 
respectively. Suppress is TOUE if the virtual buttons are being suppressed for a double click 



;no 
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Finally, Out represents the output of the tap unit, and is one of NONE, LEFT, MIDDLE, or 
RIGHT. 

Several parameters are used to conuol the tap unit TapTime is the maximum duration 
of a stroke to qualify as a tap gesture. DragTbne is the maximum interval between the initial tap 
and the return of the finger to form a drag gesture. Extendllme is the maximum amount of 
time the finger can be off the touchpad during a drag extension gesdire before the drag gesuire 
will end. HopTlme is the maximum Uft time preceding a tap to qualify as a hop. TapRadius 
is the maximum amount of motion that can occur during a tap. DragRadius is the maximum 
distance between the initial tap and the return of the finger for a drag. DragExtendRadius is 
the minimum distance between finger lift-<)£f and finger touchdown needed to qualify a^ 
extension. HtqiDistance is the minimum distance moved to qualify for a hop. Zthreshisthe 
minimum pressure (Z) to delect a finger. DragExtendSpeed is the minimum smoothed speed 
required during finger lift-off to quaUfy as a drag extension. In the claims heitan, steps reciting 
"detecting the presence" of a finger or other object (or other words to that effect) assume that a 
pressure greater than Zthresh has been detected. Finally, Ztap is the minimum Z to detect a 
tapping finger. 

FIG. 15a shows the timing of a basic tap gesture. First, a successful tap is shown, 
followed by a finger stroke which is too long to qualify as a tap. In the first stroke, the finger is 
down for time "tl", which is less than TapTime. Also (not shown on HG. 15a) the (X. Y) 
motion during time -tl" b less than TapRadius. Finally, the Z signal exceeds threshold Ztap 
for at least some part of die stroke. TTius, the stroke qualifies as a tap. The Out signal (the 
lower trace of FIG, 15a) becomes true for a certain amount of time 'tl", tiien becomes fiilse. As 
will be discussed later, the amount of time "t2" is equal to Dragnme. In die device described in 
die flowcharts to follow, die TapState variable will equal TAP for die entire interval '12". As 
prcsenUy preferred, TapTime is about 400 msec, TapRadius is about 2% of die widdi of die 
sensor pad, and Ztap is slighdy larger dian Zdiresh, whose value is adjustable by die user. 

On dierighthalf of FIG. 15a. die finger is held down for longer dian die parameter 
TapTime. shown on die figure as "t3". Thus, it wiU not qualify as a tap gesture and no Out 
signal is gaierated fitMh ibis stroke. 

In die basic drag gesture, die user taps once, quickly brings die finger back in conteu:t 
wiUi die pad, dien moves die finger in a desired direction in die XY plane of die pad. Tlie 
simulated mouse button is depressed at die beginning of die drag gesture and is released only 
when die finger is again lifted from die pad. Gesture logic arranges for die initial tap of die drag 
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gesture to be merged into the extended drag lather than presenting the host with an additional 
distinct button click. 

In a variation of the dnig gesture, the above-described gesture begins a drag which 
conluiues even when the finger is lifted. n« diag ends (i.e., the simulated mouse button is 
released) when the finger is again tapped on the sensor pad. This feature is known as "locking 
drag . Uckmg drag aflows dragging over longer distances than can be coveted by a single 
finger motion on a smaD pad. but it can be highly confusing if it is activated by mistake Tbt 
lockmg drag becomes a hidden mode, a well-known undesirable item in the study of user 
interfaces. ITius. in the preferred embodiment it is presented to the user as an option which is 
disabled by default 

In another embodiment of the drag gesture, the above-desciibed gesture wiU continue 

even though the finger has been lifted, if the finger comes hack down to the touch pad within a 
specified period of time referred to as a drag timeout IWs feature is lefo^ 
"extension". The drag timeout period is presently piefcned as 500 msec, but will be optimized, 
aswillbeappredatedbythoseof ordinary skiUintheart, with userstudies. Of course adiag 

gesture win end if dK finger is removed from the touchpad and not retunKd within the ^ 
timeout ^ 



Accordmgly. with the drag extension fi»ituie enabled, when the finger is lifted off the pad 
for less than the dnig timeout, the dnig gesture win continue, but when the fing^^ 
touchpadforapetiodgreattrthanthetimeout.thedraggestuiBends. This gives the user the 
ability to "stroke" or "row" repeatedly to drag a long distance. Unlike locking drag, drag 

extension does not appear to the user as a hidden mode, since the end of the drag occurs after the 

drag tuneout. a very short time period in human perception, if the finger does not return to the 
touch pad in time. 

However, a problem can arise widi drag extension because the drag continues through the 
dragtuneout.eventhoughthedragends. Hiere may be occasions when the user wants the drag 

to end immediately. e.g. when the drag gesture is being used to hold down a scroll bar anow 
Generally, these arrows auto-repeat until the user releases the mouse button. The contimiation of 
the drag gesture during the drag timeout would cause the scrolling »tuie to scroU past the 
desired stopping place. 

Accordmgly, the drag gesture may actuaUy represent two different gestures. A true drag 
where the cursor is moved around while the virtual button is being held down, and a press, 
where the cursor remains stationary while the virtual button is being held down. TTie drag 
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extension feature is only desired for a true drag. There arc several ways to distinguish between a 
tnie drag and a press. A true drag can be identified if the finger's speed of motion prior to lift-off 
is above a small tfueshold. A presff can be idnitified if the finger was stationary through the 
entire gesture, possibly ignoring small, inconsequential movements, or just at the time of finger 
lift-ofT. In the prefened onbodiment of the drag extensi(Hi gesture of the present invention the 
distinction between a true drag and a press is identified by the finger speed at lift-off being above 
a specified dueshold. The finger speed at lift-off is obtained as the output a running average 
filter. If the speed is below the specified threshold, the drag ends rather than being extended. In 
an alternative embodiment, the distinction between a tnie drag and a press may be identified by 
the position of the finger at lift-off. If the finger is within a selected distance from the edge of the 
pad at lift-off a true drag is identified. 

A second potential problem may occur while using drag extension if the user begins a 
new unrelated finger action during the ExtendTime period. As discussed above, when drag 
extension is enabled, a drag wiU continue even though the finger has been lifted fi^m the touch 
pad if the finger is brought back to die touch pad within the drag timeout It may be that the user 
actaally wants the drag to end when the finger is lifted, and to begin a new gesture when bringing 
the finger back down to the touchpad. One way to determine whether the drag gesnire is 
continuing or is being ended and a new finger action begun is to compare die lift-off finger 
position and the touchdown finger position. UsuaUy. a subsequent stroke of an extended drag 
would not begin at the spot where die previous stroke had ended. TTiercfore, if the finger comes 
down widiin a specified distance from the lift-off position (widiin the specified drag timeout), 
then the drag extension fisamre allows the drag to continue, otherwise the drag ends immediately. 
It will be appreciated, however, by those of ordinaiy skill in die art that the drag extension feature 
may be implemented, diough not preferably, without comparing the finger position at touch 
down wiUi the finger position at lift-off, and fiirdier, that the drag need not end imn^ 

The "edge moticm" feature described laeviously serves as an altenute way to accomplish 
long-distance drags. 

TTie drag gesture is implemented as follows. When a tap is recognized, die virtual mouse 
button is depressed as previously described. However, the virtual mouse button is not released 
until d>e finger has remained away flora the pad for a sufficient amount of time to disqualify as a 
drag gesture. This amount of time DragTime should be chosen to be long enough to allow for a 
comfortable drag gesture, but short enough so diat the click arising fiom a tap gesture is stiU 
reasonably brief. As presentiy prefened. a time of about 200 msec is used. 
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As Shown in HG. 15b, the drag gesture begins with a tap as described above, of duration 
"t4" wUch is less than TapTime. The Out signal goes high in response to this tap. Hie finger 
remains away from the pad for a pferiod "tS" which is less dian Dragrune, then it returns to the 
pad and lemains for a time "t6" which is longer dian TapHme. TTus qualifies the gesture as a 
drag. The Oat signal remidns high uiita the fmger is finally released at time n?-*. In the 
implementation of HG. 15b, thetime •'tr between the removal of the finger and the releaseof 
the virtual mouse button is zero; in other similar implementations this might be nonzero but small, 
e.g., equal to Dragflline. Note that TapState wiU equal TAP for the entire interval from "t5" to* 

There are a number of alternatives which can be considered for the timing of DragTline 
FIG. 15a shows the interval "t2". which is also die upper limit on the interval "t6". as being 
exactly equal to the parameter Dragfllme. In one altemative. DragTime is measured relative to 
DownTiiiie instead of UpTime, which is equivalent to saying that the intervals "tl" and "t2" 
C't5" and "te", respectively) must sum toBragTiine. Aconsequenceof this method is that in 
the basic tap gesture, a longer, slower tap causes a briefer virtual button clict "nas contradiction 
mala» this apprcswA less satisfying to the user dian die one shown in FIGS. 15a-b. 

In an anotiier altemative. Dragfllme is made proportional to the lengdi of interval "tl" 
OS" respectively), so that a brief tap produces a brief virtual button click, and a longer tap (up to 
the limit TapTSme) produces a longer click. This alienutive gives die user more control over die 
simulated button cUck. but it makes the behavior depend on what the user may perceive as an 
i nsig n i fi cat tt feature of the tapping action. 

There are several ways to make the duration of DragTime "proportional" to the length 
of interval "tl". In one case, the lengdi of the virtual button click or Dra^Iline is a direct 
function of die tengOi of die tap by die user. As described in die previous paragraph a brief tap 
produces a brief virtual button cUck, and a longer tap produces a longer click. Ibis approach 
seems to provide an advanuge to novice users who usuaUy tap more slowly and also require a 
longer period of time Qonger DragHine) to bring die fmger back down to begin a drag gesture. 
Unfortunately, die longer DragTime also results in a longer virtual button click (OUT signal) 
which may have undesirable side effects, including unmtentional scroU bar auto-repeating or 
"stuttoing". 

A preferred approach when differentiating between novice and expert taps is to recognize 
^taps of different lengdis. but to make die virtual button cUck or OUT signal die same lengdi for 
different tap lengttis. However, when a novice tap is recognized, die timing of die OUT signal 
will be delayed, so diat novice users will have a longer DragTime to begin a drag gesture. It 
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will be appreciated by those of ordinary skill in the art that the length of taps used to differentiate 
between novice and expert users will be optimized after user studies. It should also be 
recognized that diere are odier ways to d^ferentiate between novice and expert users. For 
example, the pressure of a novice tap is ofbsa greater than die pressure of an expert tap. 
Additionally, it may also be beneficial to use a history of tap lengdis. for example, the aveia^ 
length of several previous taps. Those of Ofdinaiy skill in the art will also recognize that decision 
between novice and aq)ert could be made by the user at a control paittL 

Referring now to FIG. 15C, the preferred embodiment of a variable DragTime as a 
function of tap lengtii is illustrated. On one hand, as presently preferred, an expert tap is seen 
having a duration for the interval "tl" of less than 200 msec. The virtual button click or OUT 
signal of 200 msec in die inter^nal "t2" begins as soon as the finger comes off the pad, thus 
providing the expert with the fastest possible response. To begin a drag gesture die finger would 
have to come back down on the touchpad befMe the 200 msec virtual buttcRi click time ended. 
Tlius, the variable DragTiiiie is chosen to be 200 msec in die preferred embodiment, thus 
reducing the chances of an expert's quick finger actions being incorrectly interpreted as a drag 
gesture. 

On the other hand, a novice tap is seen having a duration for the interval "tl" of between 
200 msec and 500 msec (in the preferred embodimoit, strokes longer than 500 msec would be 
disqualified as taps). Ths virtual button click or OUT signal of 200 msec in the interval "i2b" 
begins after a delay W of 300 msec, and as a result the user wiU have a tonger DragTime of 
500 msec in which to begin a drag gesture. TTioseof ordinary skill in the art will recognize that 
the length of die delay may be chosen in several different ways, including as a function of the up 
duration. Similarly, the ottier time-related parameters of gesture recognition such as IfopTlme 
and ExtendTlme can be adjusted when novice taps are involved. If die finger comes back 
down to begin a drag gesture before the delayed cUck has begun (Le., during die W intCTval), 
then die virtual button cUck must begin immediately as die finger comes down. Odierwise, if diis 
new finger stroke also turned out to be a tap, die first click of die resulting double-click could be 
subsumed in the "t2a" interval 

FIG. 15D shows die locking drag gesture. TTie locking drag begins widi a standard drag 
gesture involving intervals "t8" dirough "tlO". However, when die finger is raised, the Out 
signal remains high. (In die flowcharts, TapState will change from TAP to LOCKED at diis 
time.) TTie figure shows a second dragging stroke of a lengdi longer dian TapTbne (shown as 
*tl 1") which does not end die locking drag, followed by anodier stroke of lengdi *tl2" less dian 
TapTime. Since diis last stroke qualifies as a tap, it ends die locking drag at time "tl3". In die 
flowcharts. TapState changes back to TAP at diis time; a regular tap is dien processed, which 
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contunies to hold Out high for a time "tl3" equal to DragTiine as usual. A reasonable 
alternative implementation nught end the drag after a different i^ 

HG. 15E shows the drag extension-gesture. Ihe drag extension begins with a standard 
drag involving intervals "tl4" through "tiff-. The finger is raised during interval "tlT", but 
because the finger is off the toucbpad for a length of time shorter than the drag timeout parameter 
ExtendTime. the OUT signal remains high. Also (not shown on FIG. 15E) the (X.Y) motion 
during "tl7" is greater than DragExtendRadius and the smoothed average finger speed at the 
time of lift-off fix)m die pad at the beginning of interval '117" is greater than 
DragExtendSpeed. The figure shows the finger lifted for a second interval "tl 8". Since the 
period of time which the finger is lifted from the touchpad during interval "tl8" is greater than 
Extendnme. the OUT signal goes low a period of time equal to ExtendTime after die finger 
is lifted from the pad. It may be preferable to adjust ExtendTime for novice or expert users, as 
described previously for DragTiine. 
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FIG. 15F shows a double tap gesture. The double tap starts out indislinguishably fi 
drag gesture. However, the second stroke "t21" is shorter than TapTime. thus qualifying 
second tap instead of a drag. Regular tap processing causes Out to remain high for another 
interval "t23" of length DragfTiine; however, special double-tap handling shown in the 
flowcharts suppresses the virtual mouse button for a brief period "t22" after recognition of die 
tap. Urns, dte host computer perceives two distinct cKcks radier than the one long, run-together 
click that it would see without this special handling. 

Other gestarcs may be used to simulate a multi-button mouse. In one such approach, the 
basic gestures arc augmented by a "hop" gestarc, in which the finger is lifted from its resting 
place in one location on the pad and tapped a substantial distance away from die resting place. If 
the distance is suffidenfly great (HopDistance. typicaUy a fraction of the width of the sensor 
pad; presenfly preferred to be about 25%) and die duration between die lift and die subsequent tap 
is less than a suitable direshold (HopTinie. typically a fraction of a second; presendy preferred 
to be about 0.5 sec.), dien die click or drag gesture begun by tite tap is simulated on a different 
mouse button. This different button may be a fixed "secondary" button, or it may be user- 
selectable by a control panel or odier means, or it may be a function of die direction in which die 
finger hopped (e.g., to die left vs. to die right). According to a presendy preferred embodiment 
of die invention, die hop gesture is available as an option which is off by <tef ault 

Note diat, while some users prefer to tap wiUi a second finger in die hop gesture, dus 
gesture never involves more dian one finger on die pad at any one time. A similar gesture, die 
"zigzag", is also described herein and does involve the use of two fingers at once. 
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FIG. 15G shows a "hop" gesture. This gesture begiiis with the finger already on' 
the pad. The finger is then lifted for interval "t24" which is less than HopTime; the finger then 
comes down for a regular tap ♦*t25'\ Also, not shown on the figure, during interval "t24" the 
finger must have moved by at least a certain distance HopDistaiice away from its previous 
position. When this occurs, the gesture is processed as a "hop" instead of a regular tap, and the 
virtual button press "t26" occurs on the right button Out(R) instead of the usual left button 
Out(L). It is easy to see how the tap "t25" could be foUowed by further finger actions to form a 
drag or a double-tap on the light button. 

Another multi-button gesture uses "tap zones," in which the surface of the pad is divided 
into two or more zones. A tap or drag initiated in a given zone simulates an event on a button 
corresponding to that zone. EVen if the finger moves between zones during a drag, the entire 
drag is simulated on the button corresponding to the zone of the original tap that initiated the drag 
gesture. 

Figures 16a and 16b illustrate two tap zone shapes. In figure 16a, the pad is divided into 
three vertical stripes 288, 290, and 292. corresponding to the left, middle, and right mouse 
buttons, respectively. In figure 16b, the pad is divided into a main area 294 simulating the left 
mouse button, and a small comer area 296 simulating the right mouse button. The 
implementation of HG. 16b is more appropriate if one button is much more heavily used iq 
typical applications than the od»r button(s). 

It is preferable for the zones to coirespond to clearly maiked regions on the pad surface. 
It wiU be obvious to one skilled in the art that other zone shapes, such as muhiple comets or 
horizontal stripes, are equally straigjitforwaid. 

There is an interaction between tap zones and the edge motion feature that needs to be 
taken into account Particularly with the comer area 296 of FIG. 16b. tap zones encourage the 
user to tap near the edge of the pad. If edge motion is active during taps and drags or at aU times, 
then edge motion will tend to interfere with the proper behavior of comer taps. To prevent this. ' 
the edge motion enable logic of FIG. 13 can be modified slightiy. In a given stroke, edge motion 
only operates if the finger has been in the inner zone at least once during that stroke. TTius. if the 
finger touches down in the outer zone, edge motion will not activate until the finger leaves the 
edge of the pad and then returns. 

All of tiie above-described gestures are variations of basic tap and diag gestoires. In the 
system described herein, all of these gestures are recognized by the tap unit 280. The operation 
of tap unit 280 is most easUy described as an algoritiun in the form of a flowchart. From this 
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disclosure, persons of ordinaiy skill iii the art will recognize diat the t^ unit described berdn 
could actually be implemented as known and obvious equivalents such as a software program, 
hardware state machine, or otherwise. All such implementations are intended to faU within the 
scope of the present invention. 

FIGS. 17a through 17f (Comprise a flowchart for tiie operation of tap unit 280. Tap unit 
280 implements the tap, drag, locking drag, drag extension, comer-tap. and hop gestures 
described herein. In the gesture recognition operations described herein, the comertap is used to 
simulate the right virtual mouse button. Hops to the left and right are used to simulate the middle 
and right virtual mouse buttons. Simple laps simulate the left (primary) virtual mouse button. 

Processing begins at step 300 as each (X.Y,Z) sample amves from the arithmetic unit 16 
of FIG. 1. bi a pcesendy preferred embodiment of the invention, such data arrive 40 times per 
second. Hie algorithm of HGS. 17a through 17f will run from start (step 300) to finish (step 
392) every time a sample arrives. 

Step 302 determines whedier the finger is up or down by comparing Z (pressure) against 
Zthresh to determine whether a finger is present ("down") or not ("up"). Instead of a simple 
threshold comparison, two thresholds may be used to provide hysteresis as is weU-known in the 
art Hysteresis is not shown in FIG. 17a, but similar hysteresis will be illustrated iata in HG. 
20 for die "push" gesture. 

In step 304, the finger is known to be down. Hie previous Z is checked to see whedier 
the fingor was previoudy down or is just now touching down on die pad. 

In step 306, a finger-down transition has been detected. This may indicate die beginning 
of a drag gesture or a successive row in drag extension, etc. For a drag or drag extension 
gesture, the change in the finger position from the previous finger position on the touchpad 
during DragTime and Eztendlime, respectively, is checked. 

In die drag gesture Uhistrated in figure ISb, it is beneficial to check that the finger has not 
moved a great distance during time '•t5'\ die interval between the imtial tap and die retra 
finger to die pad. If die distance calculated during "tS" indicates dua die finger has returned ihe 
pad in a different location, dien a drag gesture was probably not intended. 

In die drag extensi(m gesture illustrated in FIG. 15E it is necessary to check that die 
finger has moved a great enough distance during interval "tlT*, between subsequent rows of an 
extended drag gesture. If the distance is not great enough, die drag gesbire ends. 
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Since the TapState during a drag gesture is TAP and the TapState during a drag 
«tension gesture is LOCKED, step 306 determines the TapState. If the TapState at step 306 
is TAP, then stqp 308 computes the distance between the cunent position CurPos (the filtered 
and smoothed X and Y position data) and die saved position of the previous tap, DownPos. If 
the distance is greater than some dueshold DragRadius, then execution proceeds to step 310. 
Otherwise, it proceeds to step 3 12. TTie threshold DragRadius should be some fraction of the 
width of the pad, preferably larger (more generous) than die TapRadios used in basic tap 
detection. 

At step 314, it is determined whether DragLock is enabled. If DragLock is enabled, 
the execution proceeds to step 312. Otherwise the execution proceeds to step 316. 

If the TapState of step 306 is LOCKED, and DragLock is not enabled, then a drag 
extension must be in progress. Step 316 computes the distance between die CurPos and the 
saved ending position of the previous stroke, UpPqs. If die distance is greater than some 
threshold DragExtRadius, then execution proceeds to step 312. Otherwise it proceeds to step 
310. The threshold DragExtRadius should be some fraction of the widUi of die pad, as 
determined by user testing. (Some users may prefer a DragExtRadius of zero, so that step 316 
is rffectively disabled.) 

Persons of ordinary sIdU in die art will recognize fliat several possible distance measures 
are suitable for use in steps 308 and 314. A true EucUdean distance measure is reasonable but 
expensive \o compute; a simpler measure is die sum or maximum of die absolute values of die 
distances in X and Y. Hie sum or maximum will produce a "drag zone" around the original tap 
which is diamond- or square-shaped, respectively, instead of die circular zone produced by a 
EucUdean distance measure. Experiments suggest diat users are unable to perceive die difference 
between dtese zone shapes, so whichever measure is easiest to compute is preferred. Also, die 
geometry of die finger and touchpad may cause die significant motion to lie always in one 
direction, e.g., X, in which case a simple absolute difference of X coordinates may be preferred. 

In die prrfetred embodiment, die user is able to change die level of gesture recognition 
using a control panel or odier means. If die user elects to allow taps but not drags, dien step 308 
can be programmed to go direcdy tostep310sothatalltapsare disqualified from becoming 
drags. 

In step 3 10, a drag gesture has been disqualified. TapState is changed from TAP to 
NONE; die effect will be a simple tap gesture followed by cursor motion widi no virtual button 
hdddown. 
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Step 312 records the position and the time at which the finger touched <k^ 

Step 318 initializes the TapOka, flag to FALSE. It also cleans the Suppress flag which 
IS used to delay the virtual button clicks lesnlting ftom "novice" taps. Step 318 ends the delay 
prcmaturdyifthefingacomesback down onto thetouchpad. If the new finger stroke is the 
second tap of a double tap gesture, step 3 18 is responsible for ensuring that the virtual click fiom 
the first tap is not aoddentally oppressed oitiidy. 

Step 320. which executes on all samples in which the finger is down, compares Z against 
the Ztap threshold; step 322 sets TapOkay to TRUE if Z is greater than the Ztap threshold. 
Thus, when the finger lifts, TapOkay wiU be TOUE if Z ever exceeded the tap direshold during 
the brief strdce that is a candidate for a tap gesture. 

Refening now to Fia 17b. in step 324. the finger is knovm to be off the pad. -nw 
previous Z is checked to see whether the finger was previously up or is just now bring lifted 
from die pad. 

In step 326. a finger-up transition has been detected. Various tests are made of the most 
recent stroke (finger-down period) to see if it qualifies as a top. To qualify, the stroke must have 
short duration (CurTiine minus DownThne must be less than TapTime). Uttle or no motion 
(the distonce from CurPos to DownPos must be less than TapRadios). and sufficient peak 
finger pressure (TapOkay must be TRUE), in order to qualify as a tap. 

In step 328, any finger motion which has occurred is rctK)actively canceled out by 
quickly replaying to tfie host a conesponding negative amount of motion fiom the register or 
queue in order to "undo" the already-reported motion and to restore the original cursor position as 
of the moment the finger's presence was first detected. If die motion during the stroke was sent 
to the host in die fonn of a sequence of several packets, this sequence can be saved and replayed 
in reverse. If die host's modon processing is linear, it wiU suffice to accumulate die total amount 
of motion during ifae stroke and send a compensating motion in a smgfe packet Since the 
•^acceleration" feature of a typical mouse driver activates only at high speeds, diis assumption of 
linearity is usually safe in this context. 

Step 330 takes one of several actions based on die cuirentTapState. First, if 
TapState is NONE (no gestures in progress), execution simply proceeds to step 332. In step 
332. tiie duration of die topping stroke. CurTiine minus DownTiroe, is computed to 
distinguish short, expert tops and long, novice taps. For expert tops, execution simply proceeds 
to step 338 of figure 17c. For novice tops, execution pn>ceeds to step 334, which ananges to 
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use a longer value for J^agTmie for the current gesture. These steps may simply compare the tap 
duration to a fixed threshold to choose between two fixed DragTime values, or they may use 
the tap duration to smoothly modulate the Dragllme. 

Step 334 also sets the Suppress flag to True to cause die virtual button signal to stay 
low for a short period. In the preferred embodiment, this period is chosen to be the difference 
between the novice and expert DragTiine values, so that the resulting non-suppiessed portion of 
the virtual click has the same duration in all cases, as shown in figure 15C. 

Second, if TapState is TAP (a recent tap is stiU in progress), then a double-tap has been 
detected. Step 334 sets the Suppress flag to TRUE to cause the virtual button signal to go low 
for one sample. ITus corresponds to time "t22" of figure 15F. In an alternate approach, one or 
more extra packets indicating a release of the virtual buttons can be inserted into the regular 
packet stream, rather than using a Suppress flag as shown herein. In an alternate approach, 

distinct Suppress flags could be used for the two puiposes of delaying novice cUcks and 
processing double taps; for example, a 300 msec suppression may be desirable for delaying 
novice clicks, but for double-taps it may suffice to end die suppression after at least one packet 
reflecdng the supression of virtual button has bem sent to the host 

RnaUy. if TapState is LOCKED, this is the top that ends a locking drag. Step 336 sets 
TapState back lo TAP, then skips directty to step 370 of figure 17e, bypassing the steps which 
decide which of the thiee mouse buttons to simulate. Hius. the locking drag changes back into a 
tap on die same virtual mouse button. After die usual short duration ("tl3" of figure 15D), the 
viitoal butKMi win be released. 

It is significant that the button choice (HG. 17c) is omitted in the LOCKED case. If a 
right-button locking drag is initiated by. for example, a tap in the comer of the pad, then it should 
be possible to terminate die drag by topping anywhere on the pad. not just in die comer. It is also 
significant that die button choice is included in tiie double top case. Otherwise, it would be 
impossible, for example, to perform left- and right-button cUcks in rapid alternation by topping 
alternately in two different kx»tions on the pad. • 

In an altenute embodiment, if TapState is LOCKED, TapState is set to NONE and 
step 386 is performed next TWs makes "tl3" of FIG. 15D equal to zeio. Since TapState may 
also be LOCKED during drag extension, the implementation shown here also allows the user to 
tap to cut short the drag extension period DragExtTime. In an alternate embodiment, tops 
could be ignored during die drag extension period. However, die significance of Uiis is lessened 
if DragExtTime is shon. 
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Referring now to HG. 17c, step 338 checks whether the cuirent tap qualifies as a "hop- 
gesture. This check involves several tests. First, the hop gestuie must be enabled by the user 
Second, the finger must have been raised for only a shoit amount of time between the current tap 
and the last time it was on the pad (DownTime minus Uplime must be less than Hopllme) 
Finally, the position of this tap must be significantly far away from the previous position (the 
distance from DownPos to UpPos must be greater than HopDistance). Once again, a 
variety of distance measuiBsarepossible. The operations shown m HGS. 17a through 17f 
support leftward and rightward hops; thus, a reasonable distance measure is absolute difference 
in X coordinate between DownPos and UpPos. 

In a variant which is easily seen to be nearly equivalent, CurTime and CurPos are used 
in place of DownTime and DownPos in stq> 338. 

If the tap qualifies as ahop. execution proceeds 10 step 340. Sfau» the systOT 
example supports two different hop gestures, the direction of the hop is checked to determine the 
type of gesture. If the X coordinate of DownPos (or CurPos) is less than the X coordinate of 
UpPos. a leftward hop has occurred (assuming X increases to the right). If the X cooixiinate of 
DownPos (or CurPos) is greater than the X coordinate of UpPos, a rightward hop has 

occurred. Note that, due to the checks of step 336. DownPos wifl be either significantly to the 
left or significantly to the right of UpPos at this point 

In step 342, a leftward hop causes TapButton to be set to the symbol MIDDLE, so that 
Ihe tap gesture will generate a virtual middle mouse button dick. 

In Step 344. a rightward hop causes TapButton to be set to RIGHT, initiating a virtual 
right button cl^ 

Step 346 executes if no hop was detected. It proceeds to check for the otiier supported 
alternate gesture, thecoraertap. A comer tap is a tap occurring in a small comer zone as shown 
mHG. 16b. Acomertap occurs if comertaps have been enabled by die user, theXcootdinate 
of DownPos (or CurPos) is greater than some coordinate ComerX; and the Y coordimue is 
greater than some coordinate ComerY. CoraerX and ComerY are shown on FIG. 16b. 

It shouW be obvious to one of ordinary skill in the art that other top zones, such as those 
OfHG. 16a, or multiple comer zones, can be decoded in a completely analogous way by 
examining die X and Y coordinates of the tap location. 
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In the jwesentiy prcferrcd embodiment, the user is given the choice of hop gestures, 
comer t^s, or neither, as a mechanism for simulating alternate button clicks. There is nothing 
stopping an implementation from offering both hops and comer taps at «ice, except that to do so 
would likely be more confusing than beneficial to the user. 

In step 348, no comer tap was detected, so TapButtoo is set to LEFT to simulate a cUck 
of the left virtual mouse button. 

In step 350, a comer tap was detected, so TapButton is set to RIGHT to simulate a right 
virtual mouse button click. 

Step 352 records the cuirent position as the new UpPos, the lift location used for later 
hop decoding. In general. UpPos is updated each time the finger is seen to lift from the pad. 
However, there are two exceptions to this rule. First, if the finger lift is itself part of a hopping 
tap gesture. UpPos is not updated. This is seen in the left branch of the flowchan of HG. .17c. 
nUs exception is needed to support, for example, a double-clidc of tfje right virtual buttoa TTie 
finger is lifted, moved substantially to the right, then tapped twice. The two taps will occur in 

roughly the same place. «" UpPos were updated by the first tap. the second tap would be 
decoded as a left-button click. 

Second, in the flowcharts of FIGS. 17a through 17f, UpPos is not updated on a tap that 
ends a loddng drag. User tests show that the last-lift location peiceived by the user is usually the 
last lift during the locking drag, with the terminating tap being a subconscious action whose 
location is not perceived as relevant Iheiefoie, it makes mote sense to omit the update of 
UpPos for the teraainating t^ of a locking drag. 

Step 354 sets TapState to TAP after any tap, comer tap, or hop gesture, thus recording 
that a gesture is in progress. 

Refening now to RG. 17d, step 356 executes when the finger lifts from the pad in a way 
that does not qualify as a tap. TTiis step checks if TapStote is TAP; if so, the finger must have 
lifted from the long stroke of a drag gesture, e.g.. time "tr of HG. 15b. Depending on user 
preference, the drag gesture is either temmated by the lift of the finger, or locked to become a 
locking drag. 

Step 358 checks whether locking drags have been enabled by the user. This decision 
may be made at design time, for a system in which drags are always locking or always not. or it 
may be based on a run-time option such as a control panel 
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If locking drags have not been enabled, then Step 360 checfc Whether drag e 
been enabled. ITiis decision may be made at design time, for a system in which drags ate always 

extended or not, or it may be based-on a nm time option such as a control panel. 

At step 362. if drag extension is enabled, then the speed of the finger at lift-off is checked 
toseewhetheritisaboveDragExtSpeed. ITus pemits making the distinction between true 
drags and presses described abo^«. 

In step 364, the TAPSTAIE of a drag is converted to LOCiOBD. 
In step 366, a drag is terminated by the lift of the finger. 

h step 368. which executes whenever the finger is lifted and does not qualify as a tap, 
UpPos is iq>dated to the current position as described above. 

Referring now to FIG. 17e, step 370 executes whenever the finger lifts from the pad. 
Hie variable UpTiiiie is updated to record the time at which the finger lifted fiom the pad. 

Step 372 determines the TapStote for each sample in which the finger remains off the 

pad. 

If the TapState is TAP, then step 374 compares CuiTbne minus Uplime against 
I>ra8fn«ne, to see if the finger has stayed off the pad too long after a t^ 
beginning of a drag. It should be appreciated that if variable DragThne is in use, the 
DragTlme used for comparison wUl be a function of whether a short, expert tap has been made 
or a long, novice tap has been made. If the time limit is exceeded, and TapState equals TAP. 
then execution proceeds to step 376. Odierwise, execution proceeds to step 378. 

If the TapState is LOCKED, step 380 determines whether the DragLock mode has 
beenenabled. IfDragiLock has not been enabled, then execution proceeds to step 382. If 
Dragl^ck is enabled, then execution proceeds to step 378 and the drag continues. 

Step 382 detemunes whether the finger has been off the touchpad for a period exceeding 
ExtoidTinie. If not, the drag continues and execution proceeds to step 378. Odierwise 
execution proceeds to step 376 where tiie TapState becomes NONE because tiie finger has 
been off die touchpad for too long to omtinue the drag. 
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Step 378 checks whether the finger has been off the pad long enough to end the 
suppression period begun by step 334. If so, execution proceeds to step 384, where the 
Suppress flag is set to False. • . .. 

Step 376 changes TapState fiom TAP to NONE, ending the tap and thus preventing the 
\zp from extending to a drag, or the existing drag from being extended further. 

Referring now to HG. 17f, all paths converge on step 386. which executes on every 
sample regardless of the state of the finger. TTiis step begins a series of checks to determine the 
output of the tap unit 280 for this sample. First, if the Suppress flag is TRUE in step 386, 
virtual buttons are suppressed so the ouqjut is set to NONE in step 388. 

liF the Suppress flag is FALSE and there is no button suppression, TapState is 
examined in step 390. If TapState is TAP or LOCKED, then the button indicated by 
TapButton is output in step 392. 

If TapState is NONE, no tap, drag, or hop gesture is in progress, step 394 sets the 
ou^ut to NONE in this case. 

ftocessing ends at step 396 (END). TTie tap unit wUl start over at step 300 (START) 
wten the next (X,Y.Z) sample arrives fiom the arithmetic unit 

nie edge-motion feature of FIG. 13 is most useful during a drag gesture. TTius, it is 
preferable to allow the MotionEnable input of motion unit 18 to be derived from the state of 
gesture unit 20. In particular, the "MotionEnable" signal into AND gate 268 of FIG. 13 is 
obtained by MotionEnable = (TapState = TAP) OR (TapState = LOCKED). 

Tht "zigzag" unit 282 of HG. 14 decodes a two-finger gesnire in which one finger 
remains resting on the pad while another finger taps to one side of the primary finger. In terms 
of the (X.Y,Z) information produced by the basic device, this gesture vwll effectively increase the 
Zvahie while quickly shifting theX and/or Y value by a significant distance. (When two fingere 

are on the pad. the apparent position reported is midway between the two fingers.) If such a 
change is detected, and is followed by a rapid return to the original X, Y, and Z values, then a tap 
of a second finger is recognized. 

Because a second finger tap cannot be reliably recognized until the second finger is lifted, 
sudden cursor motions first to one side and then back again arc unavoidably sent to the host Tli^ 
name "zigzag" refers to these characteristic cursor motions. A motion-reversal mechanism 
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smiJar to that used in the tap unit 280 can be employed lo ensure that the 
occurs at the original, un-zigzagged location. The only difficulty in this case is that the motions 
involved may be large enough to trigger the host's acceleration feature, which means that either 
the reversal motion must be stored and replayed packet by packet, or the zigzag unit and host 
software must cooperate to ensure that the cursor does in fact return to the desired place. 

standard anthmetic unit 16. as describedherein. However, it is clear that the arithmetic unit 16 
could be modified to produce additional information, such as the width or shape of the i 
trace profile, which would aid in the accurate recognition of this gesture 



! sensor 



HGS. ISa through 18c are a fiowchart describing the algorithm for the zigzag unit 282 

As was the c«« for the tap unit 280. the zigzag unit 282 is best described as a flowchart 
However, a hardware state machine is a known equivalent and would also be a reasonable 
unplementation of the zigzag unit 282. Unlike the tap unit 280 flowchart of HOS. 17a through 
1 7f . the zigzag unit 282 flowchart executes once per stroke; When the finger's presence is 

detected (Z > Zthresh). execution begins at step 386. If the finger leaves the pad before 
execution ends, the zigzag unit 282 abandons its compulation and starts over at step 386 on the 
next Stroke. r 

HQS. 18a through 18c iUustraie the additional feature thatleftwa«l zigzags simulate aleft 
button dick, while rightwaid zigzags simulate a right button dick. 

Thezigzagunit282iBquiresthesameposition,Z.andtiineinput8asthetapu^ It 

also reqmrcs a speed measure S. which is computed as the distance fixHn the previous to the 
current finger position at any given time. If any filtering or smootfung is done on the honnal 

0C.Y) outputs of the arithmetic unit 16 as previously disclosed, U is best to compute 
from the anfiltered(X,Y) values. r 

Slate variables of the zigzag unit 282 indude ZIgZ and ZigZ'. which record the two 
most recent values of Z; ZigPos, «id ZigPos'. which record the two most recent positions; 
ZififTune. which records the time at which the presence of the second finger was detected' 
ZigLeft and ZIgRight. which are TOUE if a leftward or rightward zigzag has been dete.!ted 
lespecdvely; and Out, which represents the output of the zigzag unit 282, and is one of LEFT* 
RIGHT, or NONE. 

n>ezigzagunit282usesseveraIparametenL ZigDistance, the minimum distance the 
fingerpositioncanmovetoqualifyforthis gesture. ZigMax-fiine is the maximum amount of 



62 



wo 97/36225 PCT/US97/05333 

time the second finger can be present to qualify. Szig is the instantaneous finger speed required 
to begin the detection of the gesture and is determined experimentally, d^>ending on the sample 
rate, sensor dimensions, and amount of analog filtering in the charge integrators. ZigRadius 
and SSgUmit specify how close the position and Z values, respectively, must return to their 
original pre-zigzag values after the second iOnger is lifted. ZigRadius is comparable to 
TapRadius, and ZigUmit is about 30% of Zthresh in the presently preferred embodiment . 

Referring now to FIG. 18a, execution begins, wheii the finger's presence is detected, at 
step400. 

In stq) 402. the zigzag unit 282 waits for approximately three (X,Y,Z) samples to arrive 
from the arithmetic unit 16. In die preferred embodiment, these samples arrive at a rate of 40 per 
second. This initial delay is to prevent Z fluctuations at the beginning of the stroke from being 
mi sta k e n for a second finger. 

In sap 404, ZigZ and ZIgZ' are initialized to a reserved value denoted as NONE. 

In step 406, die zigzag unit 282 waits for die next (X.Y,Z) sample to arrive. 

Step 408 checks for the beginning of a "zig", die first half of die zigzag gesture in which 
the apparent finger grows and jumps to one side. The speed S of die current sampte is compared 
against the threshold Szig. If S is greater, and ZIgZ contains valid data (not die reserved value 
NONE), dien execution proceeds to further validation of the gesture in figure 18b. 

In step 410, no incipient "zig" has been seen, so ZigPos' is updated to nsflect die most 
recent finger position, and ZigPos is updated to reflect the second-most-recent finger position. 
If smoodiing or filtering is appUed to die output of die aridunetic unit 1 6 of FIGS. 1 and 8. dien. 
unlike die S computation described earlier, ZigPos should be updated from die filtered or 
smoodied position data. In odier words, it should be updated from die processed position data 
whfch is used to update die cursor position on the host 

In step 412, ZigZ* and ZigZ are similarly updated to reflect die two most recent Z 
values. In typical usage patterns, a second-finger tap will typically occur to die left or right, i.e., 
different in X but not necessarily in Y. TTius, die X denominator (output of subtracter 168 of 
figure 8) will tend to increase by a clear factor of two when a second finger is present, whereas 
the Y denominator (output of subtracter 172) may or may not increase correspondingly, 
depending on die linearity of die charge integrators 44. Thus, it is preferable to use die X 
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denominator output directly as Z for the purposes of the zigzag unit 282. rather than the 
combined and processed value nonnaay obtained from block 178 of figute 8. 

After step 412, execution returns to step 406 where the next sample is awaited. 

Referring now to FIQ. 18b. step 414 records the time at which the incipient ' W was 
detected. »^ * 

Step 416 then initializes the ZigLeft and ZigRight flags. These flags will become 
TRUE if the finger is seen to move significanUy far to the left or right, respectively, of its starting 
position. * 

When a second finger comes down on the pad, the (X.Y,Z) values typicaUy take 
two or three samples to converge to their new values whkA reflect the presence of two fingers. 
Step 418 waits for one or two more samples to arrive, after which time the (X.y,Z) values 
should be settled. n,e choice of one, two. or more samples depends on factore such as the basic 
sample rate and the amount of filtering that occurs in the analog input section of t^ 

After step 418. CurPos reflects the zigged apparent finger position, and ZigPos reflects 
the position fiom two samples before the speed passed the Srigthieshdld. The two-sample 
history is important because a smaU amount of motion may have occurred due to the approaching 
second finger, before the finger touched down and produced the large motion that exceeded 
Szig. After step 418, ZigPos contains the current position saved at atime before the second 

finger is likely to have had an effect. Likewise. ZigZ contains the Z value fiom before the 
second finger arrived. 

Step 420 checks to see if Z has increased substantially beyond the resting Z value ZigZ. 
In the presently prefetied embodiment. Z is compared against a threshold 30% larger than ZigZ. 
If Z is too small, the "zig" is disqualified and execution returns to step 404. 

Step 422 checks to see if the current position is far to the left of the resting position 
ZigPos. Since the zigzag miit 282 is looking for an abrupt, ''umiaturar' change in position, it is 
preferable that step 422 use position data directly from dividers 174 and/or 1 7t, of the arithmetic 
unit 16. before any filtering or smoothing that may noimaUy be applied to posiaon data. This 
data is referred to herein as RawPos to distinguish it from the filtered and smoothed value 
CarPos. The value CurPos may be used, however, if desired, with less than optimum results. 



64 



wo 97/36225 PCT/DS97/05333 

la this implementation, step 422 compares the X coordinate of RawPos with the X 
coordinate of ZigPos minus ZigDistance. The parameter ZjgDistance can be chosen 
expeiimentally based on the observed spacing on the pad between two fingers when one finger is 
held down and the other tapped in a natural- manner. 

If a suitable Idtward zig is detected, step 424 sets ZigLeft to TRUE. 

Step 426 simUariy checks if the cunent position is far to the right of the resting position; 
ifso.step428sets2UgRighttoTRUE. , 

Step 430 then waits for the next (X,Y,Z) sample to arrive. 

Step 432 checks if the second finger has lifted from the pad, by comparing Z against a 
second "zag" threshold somewhat less dun the "zig" dueshold of step 420. On die current 
system, this threshold is roughly 20% larger dun ZigZ.) The "zag" threshold is set below die 
"zig" threshold in order to provide simple hysteresis. 

If the second finger has not yet lifted, execution returns to step 422 to continue waiting. 
If die second finger has lifted, execution proceeds to step 434 on figure 18c. 

R^etiing now to FIG. 18c, step 434 waits one or two samples for the (X,Y,Z) data to 
stalnlizB as the second finger lifts; this st^ is analogous to step 418. 

Step 436 does a final check for a complete zigzag gesture. So far, a sudden motion 
accompanied by an increase in Z has been serai, foDowed by suddoi decrease in Z. Step 436 
additionally checks tiiat die position has reoimed to its jaezigzag value (die distance from 
RawPos to ZigPos is less dian ZigRadius); die Z value has sunilarly returned to normal (die 
absolute value of Z minus ZigZ is less dian ZigUmit); and eidier ZigLeft or ZigRight but 
not bodi, is TRUE. In addition, die second-finger tap must be of short duration, Le. CurTime 
minus ZigXlme is less than ZigMaxTime. 

If die motion does not qualify as a zigzag, execution returns to step 404 to await detection 
of a zigzag gesture. If the motion has qualified as a zigzag, stq> 438 provides reverse motion to 
restore die cursor to the exact position corresponding to ZigPos. if necessary. This step is 
analogous to Step 328 of HG. 17b. 

In Step 440, a complete zigzag has been detected. If ZigLeft is TRUE, die motion is a 
leftward zigzag. Odierwise. ZigRight must be TRUE and die motion is a rightward zigzag. 
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Accordingly, either step 442 simulates a left button ptess for a leftwaid zigzag, or step 444 
simulates a right button press for a rightward zigzag. 

Step 446 pauses for a certain amount of time. For example, this step might waitfor one 

or scvend more samples to arrive, or it might waitfor one or several data packets to be 
host (NomMlly there is a one-tosine correspondence between samples and dau packets.) 

Finally, step 448 ends the simulated button press by setting Out to NONE In this 

example, the zigzag gesture only works to simulate clicks, not drags. The zigzag does not extend 

neaUy to a drag in the same way as the normal one-finger tap. since this would imply that the 

entire drag motkm occurs with two fingers held awkwardly on the pad. One alternative is to 

simulate a locking button, as is often done with trackball buttons in the art. where consecutive 

zigzagsaliematelypressaiidrefease the virtual button. Another alternative is to have the zigzag 

gesture press the virtual button, and to ndease the virtual button only when the p^ 
also removed from the pad. 



After step 448, execution returns to st^ 404 to await detection of further 



zigzag gestures. 



Another gesture which is usefiil in specialized appUcations is a "push" gestare. which 
simply compares the Z (pressure) informatioh against a second Z threshold Zpushl>i>wn. 
consideiably higher than the basic finger^tection threshold, and simulates a mouse buttoil 
aciionwheneverZexceedsthisthieshoId. This '^ush" gesture is similar to the way pen^>ased 
pointing devices normaUy operate; however, it is too imprecise and too tiring on the finger to use 
as the primary click or drag gesture. The "push" gesture is most useftd in special contexts such as 
freehand drawing programs. 

FIG. 19 is a timing diagram illustrating a "push" gesture. To perform this gesture, the 
finger is first brought near enough to cause cursor motion without causing a virtual button press. 
Next, the finger pressure increases past threshold Zposhltown. causing the virtual button to be 
pressed. Later, the pressure reduces below a threshold ZposhUp. causing the virtual button to 
be released. If ZpushUp is somewhat lower than ZpnshDown. the resulting hysteresis wiH 
prevent unwanted oscillation on the virtual button if the finger pressure varies sUghUy around the 
•*push" threshold. 

In one variant diat may be preferable, ZpushUp is set equal to Zthresh, so that once a 
push has begun the finger must be fijUy lifted from the pad in order to release the simulated 
button. Other users may prefer ZpushUp to be much closer to ZpushDown than to Zthresh. 
resulting in a more ddicate feeL 
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The push unit 284 of FIG. 14 recognizes the push gesture. FIG. 20 is a flowchart 
illustrating the implementation of this gesture. The corresponding diagram for an equivalent 
hanlwaie circuit to recognize this gesture- would be quite straightforward. 

Execution begins at sxep 450 every time a new (X,Y^ sample airives fiom the atithmetic 
unit 16. Note that the posh unit 284 examines only the Z value of each sample. 

Step 452 checks whether or not a "push" gesture is ahready in progress. 

Step 454 executes if no "push" gesture is in progress. This step checks if a "push" 
should begin. First, "push" gestures must be enabled by the user. Second, the current Z value 
must be greaier than the threshold ZpudiDownl 

If Z is sufficient to be^ a push gesdue, step 456 sets Out to LEFT to indicate that the 
left button is now pressed. 

Step 458 checks if the cunent push gesture should end. This check simply involves 
comparing Z against ZpushUp. If Z is less than ZposhUp, the push gesture is terminated in 
stq>460. 

Execution ends at step 462. If neither step 456 nor step 460 was executed then Out 
remains die same, thus providing the hysteresis referred to above. Hie state variable Out should 
be initialized to NONE at stattiq) time. 

Those of ontinary skill in the art will note tiiat die t^i unit 280 is suitable for use widi any 
touchpad that provides (X,Y) and finger-presence information, and push unit 284 is suitable for 
use with any touchpad that produces Z (pressure) information. Only the zigzag unit 282 depends 
on special characteristics of the particular touchpad technology disclosed herein, namely the faa 
that two fingers reliably report an averaged finger position. 

Two more algorithms diat are not direcdy part of gesture processing may be used to 
address minor problems diat occur when die user taps on die pad. SpecificaUy, die finger 
posidon sometimes shears sharply in one direction just as die finger lifts away! This is due to 
natural sUppage of die finger during diis action, and is aggravated when die finger is held at a 
shallow angle. A "reverse motion" algoridim can deal widi some of dus problem, but if die 
apparent finger position jumps so far diat die TapRadius test fails, reverse motion cannot help. 
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If Z IS seen to be Changing rapidly between the cunent and prcw^^ 
a^te<^„.eebetweenthecu„.nta„dp.viousZvaluesisJt^ 

umtiecanb^incieaseA NonnaUy. the oldfilter value and new quoUent are averaged with 
-ughly equal weighting topHKlucethenewmtervalue. If Z is rapidly changingXrdL 

llieresuh^s that any mot«>n occurring duringthista^^ 

before zT" * ^ 

o^^^T^r^ •'^'"'"•'^"''^^^^ Anothersolution^theprobLn 

r^u^f:"^''""^:""'"'""' ^G.21showsaniUus^vecircuitforpLonning 
the lift-jump suppression function. ^ 

of«Yri?"'''T"''°''^°'^"^^""P^ Itexanunesthesequence 

^^h.fur^erprocessedtoobtainarnotion-supp^ss^^^ 
b«t^thequoUentvaluesdirectl,..«fore«.y^^^ 

U> ab^lutev^ofthediffereocebetweenthe^ 

d^^y470. Likewise. delay 474andsabtractor476comp«te,hcahsolutecha„gei„ Adt 
47B .orms the sum of these ab^lute differences to produce speed S. the dista«« betwea, the 
cun^andprevioussamples. As previously described, it is clearthat other distance measures 
may used for this computation. Note that, in addition to the circuitry of HG. 21. the zigzag 
umt282alsomakesuseofthespeedvalueSasp,eviouslydisclosed. 

Delay units 480 and 482 leconl the previous and second-previous values of S, known as 
Sands .respecuvely. Divider 484 computes the quantity one-half of S. denoted S/2 The 
lif^jump suppression unit looks for a characteristic rebtionship among the values S S' S" 

and S/2 m an attempt to recognize spurious lift-jump events. One pnicticed in tte 

^cogmze that S" is not valid until the fourth sample of a given finger sm*e; thus, the M-jump 

suppression mut is disabled for the first three samples of ^ 

umt also employs a parameter Uftjump. a speed threshold which is determined experimentally 
andisaffectedbythesamplerateanddiesensitivityofthesensorpad. 
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Comparator 486 checks if the speed S is greater than the threshold lifUump. 
Comparator 488 checks to see if the previous speed S' is less than LiftJump. and comparator 
490 checlB if S' is less than S/2. Similaiiy. comparator 492 checks to see if the second- 
previous speed S" is less than UfUump. ^d comparator 494 checks if S" is less than S/2. 
If all five condiaons are satisfied. AND gaie 496 outputs a "suppress-motion" signal which 
suppresses the action of motion unit 18 for this sample. When motion unit 18 is supptessed. its 
output (AX.AY) is not generated for the current sampte, and its delay unit 260 is not clocked. 

The profile detected by the lift-jump suppression unit usuaUy occurs during a last 
spurious motion sample before the finger lifts. Since Z will fall below Zlhresh on the very next 
sample, the current sample win never contribute to any motion events sent to the host The 
algorithm is guaranteed by design not to suppress more than one sample in a low. Thus, if the 
algorithm "guesses wrong- and Z does not faU below Zthresh. the skipped finger motion will 
be taken up into the (AX.AY) packet produced by the next sample with only a tiny hesitation in 
die perceived cursor motion. 

Hie increased sensitivity of the touch sensor system of the present invention aflows for a 
Ughter input finger touch which makes it easy for human use. Increased sensitivity also malres it 
easier to use other input objects, like pen styU, etc. Additionally, this sensitivity aUows for a 
tradeoff against a thicker protective layer, or different materials, which both can allow for lower 
manufacturing costs. 

Greater ndse rejection allows for greater flexibiUty m use and reduced sensitivity to 
spurious noise piobtems. Two techniques are employed which allow derivation of the most 
noise-iejection benefit 

Due to the drive and sense techniques employed in the present invention, the data 
acquisition rate has been increased by about a factor of 30 over die prior art TTiis offers several 
obvious side effects. First for the same level of signal processing, the circuitry can be turned off 
most of the time and reduce power consumption by roughly a factor of 30 in die analog section of 
the design. Second, since more data is available, more signal processing, such as filtering and 
gesture recognition, can be perf(»med. 

Hie sensor electronic circuit employed in the present invention is very robust and 
caUbrates out process and systematic errors. It wiD process the capacitive information bom the 
jensor and provide digital information to an external device, for example, a microprocessor. 
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BecauseofAeuniquephysicalfeat«n«oftheprese«inv^^^ 

act phys«:aDy convenieht to Hse on portable compote. ^ 
P«>vxdesavenrconvenientai.deasy-to-u«.cursorp«^^ 

In mouse-type applications, the sensor of the present ^ 

liriTl?:t''"''"^*""^^^^ vllenplacedinthis 
locattoiw the thumb of the mer nuor be used as the position pointer on the 
^orpos^t^onoj^thecomputerscrcen. n« cu«or may then be moved witho« the 

Z^ZT :T"^'- ^^"-^^^^'^^^^totheconceptofthe 
*^tosh Power Book with its trackbaU. however the presem 

iTrrTJ"''"""^- ^^^^-^^^^^'^^cideaarepos^bleintir^ 
couldbeplaoedbelowthe-spacebar-keyforevenmotefeaturecontrol 



Thecompuux^^^^ 

di 

. . _ "i"'p™«attwiwre present equipme 



piesent invention. ^ 

utiH^.?r°"f!^'^^'^'"'^ 

utdne s^^cant panel surfi«« area for slide poren 

^.ThcpresentinventioncanprovidesuchcontrelinoBesmanto^ As 
Electromc Home Systems become more common, denser and more powerful human interface is 

features if this sensoriBchnology is used. Fy"^i«u 

Tljesensorofthepreseminventioncanbeconformedtoany«^ 
demmulUiJetouchingpoints.makingpossibte Tl« unique pressure 

detecuonabihty of the sensor technology of thepresentinvendonis^ 
Computer games, "remote" controls (hobby electronics, phmes) . and machine tool Zrols are a 

^re^ ^^"^"*^"***"" be»efitfrom thesensortechnology of the present 

K. ^"^^y''^"*' (synthesizers, dectric pianos) require velocity sensitive keys which 
can be provided by the pressure senstog ability of this sensor. There are also pitch bending 
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controls, and other slide switches that could be replaced with this technology. An even more 
unique application comprises a musical instrument that creates notes as a function of the position 
and pressure of the hands and fingeh in a veiy articiitete 3-d interface. . 

The sensor technology of the present invention can best detect any conducting material 
pressing against it By adding a compressible insulating layer covered by a layer of conductive 
material on top of the sensor the sensor of the present invention may also indirectly detect 
pressure from any object being handled, regardless of its electrical conducti^^ 

Because of the amount of information available from this sensor it will serve very well as 
an input device to virtual reality machines. It is easy to envision a construction that allows 
position-monitoring in three dimensions and some degree of response (pressure) to actions. 

While embodiments and applications of this invention have been shown and described^ it 
woiild be apparent to those skilled in die art that many more modifications than mentioned above 
are possible wiAout departing from the inventive concepts herein. The invention, therefore, is 
not to be rsstiictBd ncept in the sinrit of the appended claims. 
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atc^^-sen^gsystemp^vidingXandYposidon^W^^^^ 

dn^tinnh..™ * ^ «^ «'°d"«ive object On touch-s^ 

durationbetweenastaitandafiiiishofsaidfimpiBsenM^ l« amsc 

comparing said first duration with a first lefeience amount of time- 
'^'^*^8»8«'t^«g>^ to ttelumindicaiing the occurs 
fiistdurationislessthansaidfiBtrcferenceamountoftime; or a gesture rf said 

'^'^«»««»ndP^ceofacondttctiveobjectonthetouch-sensori^^ 
seconddutationbetweenastartandafinishofsaidsecondpresence; 

start^f^H 

startofsaidsecondiaesencewithasecondreferenceamountoftime; 

signal a™l repeatedly sending a^^ 



mamtaimng said gesture signal and repeatedly sending X and Y position 
urforrnationtosaidhostforsaidsecondelapsedto^ 
elapsed tune IS less than said third rtsference amount of tune. 



.t^ ■ '^'"'''^"^Sanextendeddtaggesturemadeonatouch-sensorpadin 
a to^^h-sensmg^stem providing X and Y position information to a host, including the ste^ of 

dm«H«n K.^ ^ ' ^ °^ " °° touch-sensoT pad of a first 

dmationbetweenastartandafinishofsaidfirstpresence; 

comparing said first duration with a first reference amount of time- 
fiBt duration IS less than said first reference amount of time; 

«..nnH H • '^'^^ " '^""'^ ^'^'^ of a conductive Uject on the touch-sensor pad of a 
second duration between a start and a finish of said second presence; 

^^"P^g^fi^^tdapsedtimebetweensaidfinishof'saidfirstpresencean^ 
start of said second presence with a second reference amount of time; 

detecting an average speed of said conductive object « said finish of said second 

presence ^ 

comparing said average speed of said conductive object at said finish of said 
second presence with a first reference speed; 
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maintaining said gesture signal and repeatedly sending X and Y position 
infonnation to said host for said second duration if said first elapsed time is less than said second 
referoice amount of time; - . 

detecting a third presence of a conductive object on the touch-sensor pad of a third 
duration between a start and a finish of said third presence; 

comparing a second elapsed tune between said finish of said second presrace and 
said start of said third presence with a third reference amount of time; and 

maintaining said gesture signal and repeatedly sending X and Y position 
information to said host for said second elapsed time and said third duration if said second 
elapsed time is less than said third reference amount of time and said average speed of said 
conductive object at said finish of said second presence is greater than said first reference speed. 

3 . A method for recognizing an ext^ded drag gesture made on a touch-sensor pad in 
a touch-sensing system providing X and Y position infonnation to a host, including the steps of: 

detecting a first presence of a conductive object on the touch-sensor ^ 
duration between a start and a finish of said first presence; 

comparing said first duration with a first reference amomit of time; 

initiating a gesture signal to the host indicating the occurrence of a gesture if said 
first duration is less than said first refaiaice amount of time; 

detecting a second presence of a conductive object on the touch-sensor pad of a 
seccmd duration between a start and a finish of said seccmd presence; 

comparing a first elapsed time between said finish of said first presence and said 
start of said second presence with a second reference amount of time; 

detecting a position of said finish of said second presence on said touch-sensor 

pad; 

maintaining said gesture signal and repeatedly sending X and Y position 
information to said host for said first elapsed time if said first elapsed time is less tiian said 
second reference amount of time; 

detecting a third presence of a conductive object on the touch-sensor pad of a fliird 
duration between a start and a finish of said tiiird presence; 

comparing a second elapsed tiine between said finish of said second presence 
said start of said third presence with a third reference amount of time; 

dating a position of said start of said third presence on said touch-sensor pad; 

comparing a distance between said position of said finish of said second presence 
and said position of said start of said third presence with a first reference distance; and 

maintaining said gesture signal and repeatedly sending X and Y position 
information to said host for said second elapsed time and said third duration if said second 
elapsed time is less tiian said third reference amount of time and said distance between said 
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posmon of said finish of said second presence and said position of said start of said third 
presence is greater than said first reference distance. 

4. Amethodforrecognizingavariabledraggesturemadeonatouch-sensorpadina 
touch-sensing system providing X and Y position infonnation to a host, including the steps of • 

*^Safi«tP«senceofaconductiveobjectonthe^^^^^ 
duration between a start and a finish of said fiist presence; 

comparing said first duration witi, first and second reference amounts of time 
said second reference amount of time being less than said first reference amountof time; 

initiating a gesture signal to the host indicating the occunence of a gestuiij if said 
first duration is less than said first reference amount of time; 

*^^»*°«««««»d|»«enceof aconduciiveobjecton the^^^ 
second duration between a start and a finish of said second presence; 

comparing M, dapsed time between said finish of said first presence and said s^ 
of Mid second presence with a third reference amount of time if said first duration is less than 
said second reference amount of time; 

maintaining said gesture signal and repeatedly sending X and Y position 
information to said host for said second duration if said elapsed timecompared to said third 

reference amount of time is less than said third reference amount of time 

comparing said dapsed time with a fourth reference amount of time if said first 

duration IS greater than said second reference amount of lime and less than said first reference 
amount of time; and 

maintaining said gesture signal and repeatedly sending X and Y position 
mformation to said host for said second duration if said elapsed time compared to said fourth 
reference amount of time is less than said fourth reference amount of time. 

5 . A method for recognizing an variable drag gesture made on a touch-sensor pad in 
a touch-sensing system providing X and Y position information to a host, including die steps of: 

detecting a first presence of a conductive object on the touch-sensor pad of a first 
duration between a start and a finish of said first presence; 

comparing said first duration with first and second reference amounts of time, 
said second reference amount of time being less than said fu« reference amount of time; 

initiating a gesture signal to the host indicating the occunence of a gesture if said 
first dwation is less than said sescond reference amount of time; 

initiating a gestare signal to the host after a delay indicating the occurrence of a 

gesture if said first duration is greater than said second reference amount of time but less than 
said first reference amount of time; 
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detecting a second piesence of a conductive object on the touch-sensor pad of a 
second duration between a start and a finish of said second piesence; 

comparing an elapsed time between said finish of said first piesence and sai 
of said second piesence with a thiid reference amount of time if^d first duration is less than 
said second r^erence time; 

maintaining said gesture signal and repeatedly sending X and Y position 
information to said host for said second duration if said elapsed time compared to said third 
reference amount of time is less than said third reference amount of time 

comparing said elapsed time with a fourth reference amount of time if said first 
duration is greater than said second reference amount of time and less than said firet reference 
amount of time ; and 

maintaining said gesture signal and repeatedly sending X and Y posidon 
infoimation to said host for said second duration if said elapsed time compared to said fourth 
reference amount of time is less than said fourth^ reference amount of time. 

6 . A method for providing an dectrical signal for moving a cuiscn* on a display 
screen associated with a computer in response to electrical signals representing the position of an 
object in a two dimensional sensing plane, including the steps of : 

providing a sensing plane including a matrix of conductors arranged as a pluraliQf 
of spaced q>art row conductive lines and column conductive lines, said sensing plane 
characterized by an inherent capacitance on die various ones of said row conductive Unes and 
column conductive lines, said capacitance vaiying with the proaumity of an object to said row and 
column ccmductive lines, said sensing plane including an inner region bounded by an outer 
region, said outer region extending inward from outer edges of said sensing plane and said outer 
region having a first portion in an X plane and a seccmd portion in a Y plane; 

sensing the capacitance on at least sdected ones of said row and column 
conductive lines; 

generating present-position signals from the sensed capacitance representing the 
present position of said object in both X and Y directions on said sensing plane; 

sensing whether said object is in said outer region of said sensing plane; 

generating first relative position X and Y signals representing the difference 
between X and Y coordinates of said present position of said object and X and Y coordinates of a 
previous position of said object, and sending said first relative position X and Y signals to said 
computer if said object is not in said outer regicm of said sensing plane; 

generating a second rdative position X signal representing the difference between 
said X coordinate of said present position of said object and an X coordinate of a fixed position 
on said sensing plane if said object is in said second portion of said outer region of said senang 
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plane, and sending said second relative position X signal to said computer so long as said object 
is in said second portion of said outer region of said sensing plane; 

generating a second-idatiye position Y signal representing the difference between 
said Y coordinate of said present position of said object and a Y coordinate of a fixed position on 
said sensing plane if said object is in said first portion of said outer region of said sensing plane, 
and sending said second relative position Y signal to said computer so long as said objectis i 
said first portion of said outer rcgbn of said sensing plane. 



7. method of claim 6 wherein said fixed position on said sensing plane is the 
geometric ontter of said smsing plane. 

8. The method of claim 6 wherein said present-position signals, said first relative 
position X and Y signals, and said second rehuive position X and Y signals are digital, signals. 

9. A method for providing an electrical signal for moving a cursor on a display 

screen associated with a computer in response to electrical signals representing the position of 
object in a two dimensional sensing plane, inchiding the stqw of : 

providing a sensing plane including a matrix of conductois arranged as a plurality 
of spaced apart row conductive Knes and column conductive lines, said sensing pla^^ 
chanicterizBd Iqr an inherent capacitance on the various ones of said row conductive 
column conductive lines, said capadtance varying wiU» the proximity of an olg^ 
column conductive lines, said sensing plane including an inner region bounded by an outer 
region, said outer region extending inward from outer edges of said sensing plane and said outer 
region having a first portion in an X plane and a second portion in a Y plane; 

sensing the capacitance on at least selected ones of said row and column 
C(»ductiye lines; 

Soieratiiig ptesent-position signals from die sensed capacitance tqjresenting die 
present position of said object in both X and Y directions on said sensing plane; 

sensing whether said object is in said outer region of said sensing plane; 

generating first relative position X and Y signals representing the difference 
between X and Y coordinates of said presem position of said object and X and Y coonlinales of a 
previous position of said object, and sending said first relative position X and Y signals to said 
computer if said object is not in said outCT region of said sensing plane; 

geaierating a second relative position X signal if said object is in said second 
portion of said outer region of said sensing plane, said second relative position X signal 
comprismg said first X signal incremented by an amount proportional to the difference in said X 
direction between said present position in said X direction of said object and a fixed X position 
on said sensing plane, and sending said second relative position digital X signals to said 
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computer so long as said object is in said second portion of said outer region of said sensing 
plane, 

generating a second-relative position Y signal if said object is in said first portion 
of said outer region of said sensing plane, said second relative position Y signal comprising said 
first Y signal incremented by an amount proportional to the difference in said Y direction between 
said present position in said Y direction of said object and a fixed Y position on said sensing 
plane, and sending said second relative position digital Y signals to said computer so long as said 
object is in said first portion of said outer region of said sensing plane. 

10. Tht metiiod of claim 9 wherein said fixed X position and said fixed Y position on 
said sensing plane define die geometric center of said sensing plane^ 

.11. The method of claim 9 whefdn said piesmt-position signals, said 
position X and Y signals, and said second relative position X and Y signals are digital signals. 

12. The method of claim 9 wherein: ... 

said amount proportional to the difference in said X direction between said 
present position in said X direction of said object and a fixed X position on said sensing plane is 
m times the difference in said X direction between said present position in said X direction of 
said object and a center X position on said sensing plane; and 

said amount propfutional to the difference in said Y direction between said present 
position in said Y direction of said object and a fixed Y position on said sensing plane is n times 
die difference in said Y direction between said present position in said Y direction of said object 
and a center Y position on said sensing plane; 

wherein m and n are numbers dnsen to impart a desired speed to the motion of 
said cursor on said display. 

13. The method of claim 12 wherein die ratio ofm ton is equal to the ratio of the 
width of said sensing plane to die height of said sensing plane. 

14. A metiiod for providing an dectrical signal for moving a cursor on a display 
screen associated with a computer in response to electrical signals representing die position of an 
object in a two dimensional sensing plane, including die steps of : 

providing a sensing plane including a matrix of conductors arranged as a pluiali^ 
of spaced apart row conductive lines and column conductive lines, said sensing plane 
characterized by an inherent capacitance on die various ones of said row conductive lines and 
column conductive lines, said capacitance varying wiOi tiie proximity of an object to said row and 
column conductive lines, said sensing plane including an inner region bounded by an outer 
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region said outer region extending inward from outer edges of said sensing plane and said outer 
region having a first portion in an X plane and a second portion in a Y plane; 

simultaneously developing a fiist set of signak proportional to the value of said 
capaatance for each of said row conductive lines when no object is located proximate to said 
sensing plane; 

^'^'«°«»«^y«tevelopingasecondsetofsignalsproporii^ 
capacitance for each of said cohimn conductive lines when no object is located proximate to said 
sensmg plane; i- «»u 

simultaneously developing a third set of signals proportional ID the value of said 
capacitance for each of said row conductive lines when an object is located proximate to said 
sensing plane; 

simultaneously developing a fourth set of signals proportional to the value of said 

capacitana for each of said cdlumnconduciivelineswhensaidobjw^ 
sensingplane; 

computing a first wdghled average of the difference between said first set of 
signals and said third set of signals to generate a present-position signal in the X direction of said 
SMsmg plane; and 

computing a second weighted average of the difference between said second set of 

signals and said fourth set of signals generate a presentix«dtion signal in the Y direction 
sensingplane; 

generating first relative position X and Y signals representing Uie difference 

betweensaidpn»ent-positionsignalsinbothXandYdii8ctionsandap«evioussetofp«^^ 

position signals in botii X and Y directions, and sending said first relative position X and Y 
signals to said computer if said object is not in said outer region of said sensing plane, and; 

generating a second relative position X signal representing die difference b«ween 
said X coordinate of said present position of said object and an X coordinate of a fixed position 
on said sensing plane if said object is in said second portion of said outer region of said sensing 
plane, and sending said second relative position X signal to said computer so long as said object 
IS m said second portion of said outeriegion of said sensing plane; 

generatiiig a second relative position Y signal leptBsenting the dif&srra 

saidXcoordinate of said present position of said ol^andaYcboidinateofafixedpositiM 
said sensing plane if said object is in said first portion of said outeriegion of said sensingplane 
and sendmg said second relative position Y signal to said computer so long as said object is i 
said first portion of said outer region of said sensing plane. 



im 



15. Tlie method ofclaim 14 wherein said fixed position on said sensing plane is die 
geometric oent^ of said sensing plane. 
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1 6. The method of claim 14, wh^ein the steps of simultaneously developing said 
first, second, third, and fourth seu of signals includes the steps 0^ 

placing a first known voltage on said row conductive lines; 

discharging said row conductive lines for a fixed time at a fixed current; 

measuring and storing a first set of row conductive line resultant voltages across 
said row conductive lines; 

placing a second known voltage on said row conductive lines; 

charging said row conductive lines for said fixed time at said fixed current; 

measuring and storing a second set of row conductive line resultant voltages 
across said row conductive lines; 

avwaging corresponding ones of said first and second sets of row conductive line 
resultant voltages; . 

placing a first known voltage on said colunui conductive lines; 

discharging sdd column conductive lines for a fixed time at a fixed cunent; 

measuring and storing a first set of columin conductive line resultant voltages 
across said colunm conductive lines; 

placing a second known voltage on said column conductive lines; 

charging said column conductive lines for said fixed time at said fixed current; 

measuring and storing a second set of colunm conductive line resultant voltages 
across said column conductive lines; and 

averaging corresponding ones of said first and second sets of column conductive 
line resultant vdtages. 

1 7. The method of claim 14 wherein the steps of ccmiputing said first and second 
weighted averages comprises the steps of: 

computing a sum and a weighted sum of said first set of signals; 

computing a sum and a weighted sum of said second set of signals; 

computing a sum and a weighted sum of said third set of signals; 

computing a sum and a weighted sum of said fourth set of signals; 

computing a row numerator by subtracting said weighted sum of said first set of 
signals from said weighted sum of said third set of signals; 

computing a row cfenominator by subtracting said sum of said second set of 
signals fi-om said sum of said fourth set of signals; 

dividmg said row numerator by said row denommator to derive a row position 
signal representing the position of said object in a row dimension; 

ccmiputing a colunm numerator by subtracting said weighted sum of said second 
set of signals from said weighted sum of said second set of signals; 
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«'"P"'^Sacolumndenommatorbysubiractingsaidsumofsaid«^^^ 
signals from said sum of said second set of signals; and 

nnciri • /'^'^*^*'*^'°''^""'^'^^^'>y^d^°''™«denomin^^ 
position signal lepiesentmg the position of said object in a column dimension. 

18. Themethodofdaim 17 including theiiirther Steps of: 

/°'^S^'^'»*"°'^d«id^ightedsumofsaidfestandthirdsetofsigw^ 
stored sum and a stoied weighted sum of said second and fourth sets of signals; and 

'^"'S^dstonsdsumandsaidstoredweightedsumincomputingsubsequent 
ones of said low numenttors and denominators and said column numerators and denoarinatois 

mpiesentativeofasubsequentposiaonofsaidobjectinsaidtwodimen^^^^ 
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